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Abstract 

"As has often been the case wfth NP-completeness proofs, PPAD-completeness proofs will 

be eventually refined to cover simpler and more realistic looking classes of games. And then 
researchers will strive to identify even simpler classes." -Papadimitriou (chapter 2 of [37]) 

In a landmark paper [39], Papadimitriou introduced a number of syntactic subclasses of 
TFNP based on proof styles that (unlike TFNP) admit complete problems. A recent series 
of results [12, 19, 6, 7, 8, 9] has shown that finding Nash equilibria is complete for PPAD, a 
particularly notable subclass of TFNP. A major goal of this work is to expand the universe 
of known PPAD-complete problems. We resolve the computational complexity of a number of 
outstanding open problems with practical applications. 

Here is the list of problems we show to be PPAD-complete, along with the domains of 
practical significance: Fractional Stable Paths Problem (FSPP) [21] - Internet routing; Core 
of Balanced Games [41] - Economics and Game theory; Scarf's Lemma [41] - Combinatorics; 
Hypergraph Matching [1]- Social Choice and Preference Systems; Fractional Bounded Budget 
Connection Games (FBBC) [30] - Social networks; and Strong Fractional Kernel [2]- Graph 
Theory. In fact, we show that no fully polynomial-time approximation schemes exist (unless 
PPAD is in FP). 

This paper is entirely a series of reductions that build in nontrivial ways on the framework 
established in previous work. In the course of deriving these reductions, we created two new 
concepts - preference games and personalized equilibria. The entire set of new reductions can 
be presented as a lattice with the above problems sandwiched between preference games (at 
the "easy" end) and personalized equilibria (at the "hard" end). Our completeness results 
extend to natural approximate versions of most of these problems. On a technical note, we wish 
to highlight our novel "continuous-to-discrete" reduction from exact personalized equilibria to 
approximate personalized equilibria using a linear program augmented with an exponential 
number of "min" constraints of a specific form. In addition to enhancing our repertoire of 
PPAD-complete problems, we expect the concepts and techniques in this paper to find future 
use in algorithmic game theory. 
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1 Introduction 



Intuitively, the notion of stability implies the absence of oscillations over time and encompasses 
the concepts of fixed points and equilibria. Stability is important in a variety of fields ranging from 
the practical - the Internet - to the theoretical - combinatorics and game theory. For important 
practical systems (e.g. Internet), the existence and computational feasibility of stable operating 
modes is of profound real-world significance. On the more abstract front, the study of stable 
solutions to combinatorial problems has a distinguished tradition dating back to, at least, the 
Gale-Shapley algorithm [17]. It is often the case, as with Nash's celebrated theorem [36], that 
fractional stable points are guaranteed to exist even when integral points don't. In this paper, we 
focus on fractional stability and resolve the computational complexity of a set of eight problems 
with applications to a variety of different domains. Six of these are pre-existing problems. Below 
we provide elaborate motivation for two of the pre-existing problems - Fractional Stable Paths 
Problem (FSPP) and Core of Balanced Games. The remaining four are: Scarf's lemma, 
a fundamental result in combinatorics with several applications [41], Fractional Hypergraph 
Matching [1], useful for modeling preferences in social-choice and economic systems, FBBC, the 
fractional version of the Bounded Budget Connection (BBC) game [30], which models decentralized 
overlay network creation and social networks, and Strong Fractional Kernel [2], of relevance 
to structural graph theory. In addition, we define two new concepts — personalized equilibria for 
matrix games and preference games — which are not only useful tools for carrying out reductions 
but also of independent interest. 

Fractional Stable Paths Problem. Griffin, Shepherd and Wilfong [20] showed how BGP 
(Border Gateway Protocol, the routing mechanism of the Internet) can be viewed as a distributed 
mechanism for solving the Stable Paths Problem (SPP). They showed that there exist SPP instances 
with no integral stable solutions, a phenomenon that would explain why oscillation has been ob- 
served in Internet routes. Route oscillation is viewed as a negative, since it imposes higher system 
overheads, reorders packets, and creates difficulties for tracing and debugging. Subsequently, Hax- 
ell and Wilfong [21] introduced FSPP: a natural fractional relaxation of SPP with the property 
that a (fractional) stable solution always exists. Intuitively, FSPP can be viewed as a game played 
between Autonomous Systems that each assign fractional capacities to the different paths leading 
to a destination in such a way that they maximize their utility without violating the capacity con- 
straints of downstream nodes. Understanding the computational feasibility of finding the equilibria 
of this game could help to develop techniques for stable routing in the Internet. 

Core of balanced games. The notion of core in cooperative games is analogous to that of 
Nash equilibrium in non-cooperative games. Informally, a core is the set of all outcomes in which 
no coalition of players has an incentive to secede and obtain a better payoff, either viewed as 
a set (transferable utilities) or individually (non-transferable utilities). Necessary and sufficient 
conditions for the nonemptiness of the core in games with transferable utilities is given by the classic 
Bondareva-Shapley theorem [5, 43], which also yields a polynomial-time algorithm for finding an 
element in a nonempty core. Subsequently, in a celebrated paper. Scarf [41] generalized their result, 
developed certain sufficient balance conditions for the nonemptiness of the core in games with non- 
transferable utilities, and presented an algorithm for finding a point in the core. As noted by Jain 
and Mahdian in Chapter 15 of [37], "However, the worst case running time of this algorithm (like 
the Lemke-Howson algorithm) is exponential." Resolving the computational feasibility of finding 
the core in balanced games is of considerable significance in the theory of cooperative games. 

Personalized equilibria for matrix games - a generalization. Imagine a business man- 
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ufacturing and selling outfits consisting of a pant (solid or striped) and a shirt (cotton or wool). 
The manager of the location producing pants decides on the ratio of striped pants produced to 
solid pants while the manager at the location producing shirts decides on the ratio of cotton shirts 
produced to wool shirts. Each manager is then given half the total number of shirts and pants (in 
the proportions decided) and has to match them into outfits and sell them at her own location in 
such a way as to maximize her individual profits. Personalized equilibria for matrix games capture 
exactly this situation: each player chooses a distribution over her own actions, but then each player 
independently customizes the matching of her own actions to the actions of other players in such 
a way as to maximize individual payoff. The concept of personalized equilibria for matrix games 
generalizes a number of games and problems, including FSPP and FBBC. 

Preference games - a specialization. Consider a world of bloggers where each blogger has a 
choice of actions. They can fill their blogs with original content or they can copy from the original 
content on others' blogs. Naturally, each blogger has a preference order over the content of the 
different bloggers (as well as their own). Also, of course, more cannot be copied from another 
blog than the amount that other blogger has written. The preference game models each blogger's 
choice of what percentage of his blog is original and what percentages are copied from which other 
blogs. Such preference games arise whenever each player has a preference among her actions, 
and her distribution over her actions is constrained by others' distributions. The definition of a 
preference game is surprisingly simple, making this a great candidate problem for reductions. In 
fact, preference games are reducible in polynomial-time to all the problems considered in this paper. 

1.1 Our Contributions 

Hewing to the dictum that a picture is worth a thousand words, we present a diagram (Figure 
2) showing the different reductions. The takeaway is that all the eight problems of interest are 
PPAD-complete. To be precise, we show that for all these problems, the exact versions are in 
PPAD, and our reductions extend to natural approximation versions to show that there are no 
fully polynomial-time approximation schemes (unless PPAD is in FP). Our reductions build on 
prior work in intricate and involved fashion. 

Prom a conceptual standpoint, we believe there is merit in the definitions of preference games 
and personalized equilibria. Preference games are very simple to describe and model a number of 
real-world situations, such as the blogger example mentioned earlier. Yet we can show that the set 
of equilibria of preference games can be nonconvex and in fact, are hard even to approximate. As a 
counterbalance we show that finding equilibria in the subclass of symmetric (for a natural notion of 
"symmetric") preference games is in FP. Personalized equilibria of matrix games are, we believe, 
a fascinating solution concept worthy of independent study. Not only do they model real-world 
situations as motivated earlier by the example of the apparel company, but they also constitute a 
natural generalization of a variety of predefined games, such as FSPP and FBBC. Our results on 
the hardness of approximating personalized equilibria for A;-player games apply for k > 4. We show 
that finding personalized equilibria of 2-player games is in FP. The k = 3 case is open. 

From a technical standpoint, we particularly wish to highlight our reduction from finding exact 
personalized equilibria to finding approximate personalized equilibria. To capture exact person- 
alized equilibria, we write a linear program plus an exponential number of single-variable min 
constraints. These are constraints specifying that the minimum of a subset of variables is 0. Us- 
ing this specification, we prove the existence of rational equilibria. Furthermore, we reduce to 
approximate personalized equilibria by showing that an e-approximate equilibrium for sufficiently 
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small e points us to a subset of the variables that can be set to to simultaneously satisfy all 
of the min constraints, leaving us with a polynoniially-sized feasible linear program for an exact 
equilibrium. With this reduction in hand and an additional technical bound on the size of short 
feasible vectors, we are then able to carry through the reduction to End-of-the-Line to show that 
personalized equilibria is in PPAD. 

1.2 Related Work 

Nash profoundly changed game theory by demonstrating the existence of mixed equilibria 
[35, 36]. Decades later, on the computational front [37], the complexity class TFNP was in- 
troduced by Megiddo and Papadimitriou [34]. Papadimitriou's seminal work [39] not only defined 
a number of syntactic subclasses of TFNP (including PPAD), but also proved that a variety of 
problems, including discrete versions of Brouwer's fixed point theorem and Sperner's lemma, are 
PPAD-complete. The problem of finding Nash equilibria was left open. Recently, a series of papers 
comprising different author combinations of the two teams, Daskalaikis-Goldberg-Papadimitriou 
[12, 19] and Chen-Deng- Teng [6, 7, 8, 9] culminated in establishing that approximating Nash equi- 
libria with two players, 2-Nash, is hard. The reductions in our work build on the framework 
established in these papers. 

BGP has been the focus of much attention since its inception [40, 45]. As mentioned earlier 
SPP was introduced by Griffin, Shepherd and Wilfong [20] to explain the nonconvergence of BGP 
[47]. Haxell and Wilfong [21] defined FSPP and proved the existence of an equilibrium using 
Scarf's lemma and a compactness-type argument. They left open the complexity of finding an 
equilibrium. Our reduction from personalized equilibria to End-of-the-Line is a different approach 
that generalizes the Haxell- Wilfong existence result while preserving computational tractability. 
Kintali [27] presented a distributed algorithm for finding an e-approximation for FSPP that is 
guaranteed to converge, although no bounds are given on the time-to-convergence (our results 
imply a polynomial time bound is unlikely). 

Cooperative games, the study of mechanisms to sustain and enforce cooperation among willing 
agents, has a rich and extensive literature [10, 18, 11, 16, 29]. As mentioned earlier, in a celebrated 
paper Scarf [41] generalized the classical Bondareva-Shapley theorem [5, 43] result and developed an 
algorithm for finding a point in the core of balanced games with non-transferable utilities. More 
recently, Markakis and Saberi [33], Immorlica, Jain and Mahdian [23] studied certain classes of 
games with non-transferable utilities in the context of the Internet; however, it is unclear that their 
problems are even in TFNP. Scarf's paper [41] also contains Scarf's lemma, an important result in 
combinatorics which played a crucial part in the FSPP existence proof of Haxell and Wilfong [21]. 
Aharoni and Holzman [2] proved that every clique-acyclic digraph has a strong fractional kernel, 
and Aharoni and Fleiner [1] proved that every hypergraphic preference system has a fractional 
stable matching. Both of these proofs are based on Scarf's lemma. The computational complexity 
of these problems was left unresolved. 

The BBC game, introduced in [30, 31], builds on a large body of work in network formation 
games [24, 4]. A direct precursor to BBC games was introduced by Fabrikant et al. [15]. Fractional 
BBC games were introduced in [31], but the problem of finding an equilibrium was left open. 

2 The Class PPAD 

A major contribution of this paper is to expand the set of problems known to be PPAD- 
complete. The class PPAD (Polynomial Parity Argument in a Directed graph) was introduced 
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by Papadimitriou in [39], which defined a number of syntactic classes in the semantic class TFNP, 
or the set of all total search problems. A search problem S consists of a set of inputs C S* such 
that for each x ^ Is there is an associated set of solutions Sx C Sl^l for some integer k. For each 
X E Is and y G Sl^l , it is decidable in polynomial time whether or not y is in Sx- A search problem 
is total if Sx ^ $ for all x e Is- TFNP is the set of all total search problems [34]. Since every 
member of TFNP is equipped with a mathematical proof that it belongs to TFNP, a number of 
syntactic classes can be defined based on their proof styles. The complexity class PPAD is the 
class of all search problems whose totality is proved using a directed parity argument. 

Problems in PPAD are reducible to the End of the Line problem. In End of the Line, 
we are given a finite directed graph in which each node has at most one outgoing edge and at most 
one incoming edge. The input to the problem is not a complete list of the nodes and edges; such 
a list may be exponentially large in the size of the input. Instead, we are given an initial source 
node and a circuit. The circuit takes a node name as input and in polynomial time returns the 
next node (the other end of the outgoing edge from the input node) and the previous node (the 
other end of the incoming edge into the input node). If the input node is a source (or sink), null is 
returned as the previous (or next) node. The problem for End of the Line is to find a sink or a 
source other than the initial source. 

Throughout this paper, we use PROBLEM A <p PROBLEM B to mean "There exists a polynomial 
time reduction from finding a stable point in PROBLEM A to finding a stable point in problem 

PROBLEM B." 

3 Preference Games 

In this section, we define a very simple game, the preference game. Each player has a preference 
list across the set of players and must assign weight to each player. No player may put more 
weight on another player than that player puts on itself. A best response for a player occurs when 
that player cannot move weight from a lower preference player to a higher preference player. We 
show in Section 3.2 that when preferences are symmetric, it is very easy to find an equilibrium in 
which all weights are either or 1. However, in Section 3.3 we show that the set of equilibria in 
general preference games may not be convex, implying that we cannot hope to find an equilibrium 
using convex programming, and in Section 3.4, we show that finding an equilibrium in general 
preference games is PPAD-hard. In Section 3.5, we define an e-approximate equilibrium for the 
preference game and extend our PPAD-hardness result to approximate equilibria. Our notion of 
approximation carries though all of the reductions in later sections, so we prove that there are no 
fully polynomial-time approximation schemes (unless PPAD is in FP) for computing stable points 
in any of the problems discussed in this paper. Finally, in section 3.6, we define the degree of a 
preference game, and show that any preference game can be reduced to a preference game with 
constant degree. 

3.1 Preference Games 

In a preference game with a set S of players, each player's strategy set is S- Each player i G S 
has a preference relation >zi among the strategies. ^ For strategies j and k, j >zi k indicates that 
player i prefers j at least as much as k. When it is clear from context that we are talking about 
the preferences for player i, we write j k instead of j )zi k. Each player i chooses a weight 
distribution, which is an assignment Wi : S ^ [0, 1] satisfying two conditions: (a) the weights add 

preference relation is a binary relation that is transitive and complete. 
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up to 1: X]jg5 = 1; and (b) the weight placed by i on j is no more than the weight placed by 

j on j: Wi{j) < Wj{j) for all i,j G S. 

Given weight assignments wi, w[, and W-i such that {wi,W-i) and {w'j^jW-i) are both feasible, 
we say Wi is lexicographically at least w[ (with respect to w-i) if for all j G /S, "^k^ij "^ii^) — 
^k^ij ^i(^)' ^^^^ ^« lexicographically maximal (implied: with respect to w^i) if (wi, w^i) 

is feasible and Wi is lexicographically at least every assignment w'^ such that (u/-, w^i) is feasible. An 
equilibrium in a preference game is an assignment w = {wi : i G 5} such that Wi is lexicographically 
maximal with respect to W-i for alH G 5. 

Every preference game has an equilibrium, a fact which can be shown using standard fixed-point 
theorems; we defer the proof to Section 4, where we show the existence and PPAD-membership of 
a more general class of equilibria. 



Preference Game: Given a set of players [n], each with strategy set [n], and a preference 
relation )zi among the strategics for each player i. Find a feasible weight assignment w such 
that for all i, Wi is lexicographically maximal with respect to w-i. 



3.2 Symmetric Preference Games 

In a symmetric preference game, the players are ordered {1, . . . ,n}. Given the order of the 
players, we have the following symmetry in the preferences: if i < j, and if i >zj j, then j i. In 
other words, if a player j is later in the order than i, and if j prefers i over itself, than the earlier 
player i also prefers j over itself. 

Theorem 3.1. In any symmetric preference game, an equilibrium in which all weights are or 1 
can be found in polynomial time. 

Proof. If our preference rules obey this style of symmetry, we can use Algorithm 1 to find an 
equilibrium. 

Algorithm 1 Finding an equilibrium in a symmetric preference game 

1: Sort the players into their symmetry order. 

2: Set all weights to —1. 

3: for i = 1 . . . n do 

4: if ^Ui{^) = — 1 then 

5: Assign Wi{i) = 1. 

6: for j = i + 1 . . .n do 

7: Assign 'Wi{j) = 0. 

8: if j i then 

9: Assign Wj{j) = 0. 

10: for z = 1 . . . n do 
11: if Wi{i) = then 

12: Find the player j with Wj{j) = 1 that is highest in i's preference list. 

13: Assign Wi{j) = 1. 

14: Assign Wi{k) = for all other k ^ j. 



Since each player has weight 1 assigned to exactly one strategy. Algorithm 1 assigns a feasible 
set of weights. To show that Algorithm 1 finds an equilibrium, we must show that the results of the 
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algorithm obey the foUowing. (a) If Wi{i) = 1, then there is no j such that j >zi i with Wj{j) = 1, 
and (b) if Wi(i) = 0, then there is some j such that j )zi i with Wj{j) = 1. 

To show (a): consider the point in the algorithm at which Wi{i) is set to 1. By this point, we 
have already looked through all j ahead of i in the ordering. Since Wi{i) is still —1, for each j for 
which we assigned Wj{j) = 1, none had i )zj j- By symmetry, this means that no j ahead of i in 
the ordering has Wj{j) = 1 and j i. Now, for all j following i in the ordering, if j >zi i, then we 
assign Wj{j) = immediately after we assign Wi{i) = 1. 

To show (b): Consider the point at which we assigned Wi{i) = 0. We had just assigned Wj{j) = 1 
for some j ahead of i in the order. We found that i >zj j, which by symmetry implies that j i, 
as required. □ 

3.3 Non-Convexity 

Although symmetric preference games have a simple equilibrium which can be found in poly- 
nomial time, general preference games are more complex. In this section, we show that the set of 
equilibrium for a preference game may not be convex. 

Theorem 3.2. There exists an instance of the preference game for which the set of equilibria is 
not convex. 

M) x^y^ Xi). 

@r::i) 4r-© (Sr-@ <ifz:m Cu^'^^m^ serf® ^x:m"^--Ji) 

(a) The a players assign weights (b) The o players assign weights 1/2— (c) Combining half of each equilib- 
1/2, 1/2, the 6 players both use 6i, the 1/2, the 6 players both use 62, the c rium, x will assign 1/2 to ai, 1/4 to 
c players both use 02. players both use ci. each of 61 and ci. x could improve by 

assigning weight only to a\ and h\. 

Figure 1 : Example of an instance of the preference game for which the equilibrium set is not convex. 



Proof. Consider the following instance of the preference game. We have 3 sets of 2 players each, 
0-1,0,2, bi,b2, ci,C2, and one additional player, x. The preference lists for these nodes arc: 04: 
(02,01); 02: (01,02); 61: (62,61); 62: (61,62); ci: (c2,ci); C2: (ci,C2); x: (01, 61, ci, x). (Each list 
gives strategies in order from most preferred to least preferred.) We now show two equilibria whose 
linear combination is not an equilibrium. In equilibrium w (figure 1(a)): Wai{ai) = ^, 1^01(02) = ^, 

Wa2{a2) = 5, Wa^iai) = I, WbXh) = 1, ^2(61) = 1, Wci{c2) = 1, ■W^C2(C2) = 1, VJx{ai) = ^, 

Wx{bi) = \. In equilibrium w' (figure 1(b)): w'^^{ai) = \, ^^^(02) = \, w'^^{a2) = 5, w'^^^^-i) = ^, 
w'l^^ih) = 1, ^^62(62) = 1, w^ci(ci) = 1, Wc2(ci) = 1, w'Jioi) = 2, w'^{ci) = 5. It is easy to verify 
that w and w' are both equilibria, and in a solution X - w + {1 — X) ■ w' (for any A > |) (figure 1(c) 
shows A = ^), player x would do better by moving more weight to its second preference. Therefore, 
the convex combination of w and w' is not an equilibrium. □ 

3.4 PPAD Hardness 

We show that finding an equilibrium in preference games is PPAD-hard. We will follow the 

framework of [12], which shows that finding a Nash equilibrium in a degrec-3 graphical game 
is PPAD-hard, using a reduction from the PPAD-complete problem 3-D Brouwer. In this 
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problem, wc arc given a 3-D cube in which each dimension is broken down into 2^" segments - 
thereby dividing the cube into 2'^"' cubelets. We are also given a circuit that takes as input the 3 
coordinates of the center of a cubelet (each as an n-bit number) and returns a 2-bit number that 
represents one of four 3-D vectors: either (1, 0, 0), (0, 1, 0), (0, 0, 1), or (—1, —1, —1). A solution to 
the 3-D Brouwer instance is a cubelet vertex such that the set of 8 results obtained by running 
the circuit on each of the 8 cubelets surrounding the vertex contains each of the four vectors at 
least once. 

As in [12], we will construct a set of gadgets to simulate various arithmetic operators, logical 
operators, arithmetic comparisons and other operators. We then follow their framework to system- 
atically combine these gadgets to simulate the input boolean circuit and to encode the geometric 
condition of discrete fixed points in the 3-D Brouwer instance. In the preference game we con- 
struct, we specify the preference relation of any player P by an ordered list of a subset of the players, 
with the last element being P, also referred to as the "self" strategy. When wc say that a player 
P plays itself with weight v, we mean that P assigns a weight of v to strategy P. We'll engineer 
the payoffs such that the game is only in equilibrium if the weights assigned by certain players 
to themselves successfully echo the inputs and outputs of 8 copies of the circuit that surround a 
solution vertex of the 3-D Brouwer instance. 

For this reduction, we require the following sets of players. 

1. One player for each of the 3 dimensions (the coordinate players). If the graph is an equilibrium, 
each coordinate player plays itself with weight equal to its coordinate of the 3-D BROUWER 
solution vertex. 

2. One player for each of the bits of each of the 3 coordinates (the bit players). In order to 
force these players to correctly represent the bits, we need some additional players. Assuming 
we've correctly calculated the first i — 1 bits of coordinate x (call them xq, . . . , Xi-i), we can 
create the z*'* bit as follows. One player will play itself with weight Pi = x — X^}=o W' '^^^ 
bit player will play itself with weight equal to the i*'* bit. If Pi > i , then this bit should be 
1. Otherwise, it should be 0. Therefore, in order to properly extract the bits, we create the 
following four types of players. 

(a) HALF player: In any equilibrium in which a given player plays itself with weight a, the 
HALF player will play itself with weight |. 

(b) DIFF player: In any equilibrium in which two given players play themselves with weights 
a and b, the DIFF player will play itself with weight a — b. 

(c) VALUE player: In any equilibrium, the VALUE player plays itself with weig ht |. This 
can be easily created by combining a player whose first preference is itself with a HALF 
player. 

(d) LESS player: In any equilibrium in which two given players play themselves with weights 
a and b, respectively, the LESS player plays itself with weight 1 iff a > 6, and plays itself 
with weight otherwise. (Actually, the LESS player we create will be inaccurate if a 
and b are very close, which we discuss more below.) 

3. One player simulates each type of gate used in the circuit of the 3-D BROUWER instance. 
For this, we create 3 more types of players. 
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(e) AND player: In any equilibrium in which two given players play themselves with weights 
a and b G {0, 1}, the AND player will play itself with weight a Ab. 

(f ) OR player: In any equilibrium in which two given players play themselves with weights 
a and b G {0,1}, the OR player will play itself with weight aV b. 

(g) NOT player: In any equilibrium in which a given player plays itself with weight a 
G {0, 1}, the NOT player will play itself with weight -la. 

4. Finally, we need to ensure that the graph is in equilibrium if and only if all four vectors are 
represented in the results of the 8 circuits. As in [12], we will represent the output of each 
circuit using 6-bits, one each for +x, —x, +y, —y, +z, —z. Now, the 4 possible result vectors 
are represented as 100000, 001000, 000010, and 010101. We can use these circuit results with 
only two additional types of players to feed back into the original coordinate players. First, 
we will create an OR player for each of the 6 bits (over the 8 vertices) , which yields a result of 
six I's if and only if this is a solution vertex. Therefore, an AND player for each coordinate 
will all return 1 if and only if this is a solution vertex; at least one of the coordinates will be 
otherwise. We can turn this around using a NOT player for each coordinate, so that we get 
all O's if and only if this is a solution vertex. Finally, we need the last two new player types, 
which we'll use to add these results back to a copy of the original coordinates (the result will 
be the original coordinate player). 

(h) COPY player: In any equilibrium in which a given player plays itself with weight a, the 
COPY player will also play itself with weight a. 

(i) SUM player: In any equilibrium in which two given players play themselves with weights 
a and b, the SUM player will play itself with weight min(a + 5, 1). 

If the coordinates represented a solution vertex to the 3-D Brouwer instance, then all the 
values we've added back in will be zero; so the coordinate players cannot do better by changing 
their strategies. On the other hand, if the coordinates do not form a solution vertex, then 
at least one of the values is 1, so that the coordinate player will have incentive to change 
strategies and play more weight on itself. 

We now describe how to create the new types of players (gadgets) required for the reduction. 

For each of these gadget definitions, we assume we are given a preference game such that in any 
equilibrium, player X plays itself with weight vi and player Y plays itself with weight V2- For the 
first three gadgets, we assume vi,V2 G {0, 1}. For the rest of the gadgets, we assume vi,V2 G [0, 1]. 



OR(X, Y) 

We can add a new node R = OR(X, Y) that will play itself with weight vi V V2 in any equilibrium. 
Create a node Ri with preference list {X,Y,Ri). Let node i?'s preference list be {Ri,R). Now, if 
vi and/or V2 is 1, then Ri will play i?i with weight 0, so R will play itself with weight 1. If both 
vi and 'U2 is 0, then Ri will play itself with weight 1, so i? will play Ri with weight 1 and R with 
weight 0. 
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NOT(X) 

We can add a new node A'' = NOT(X) that will play itself with weight -i^i in any equilibrium. Let 
node A'''s preference list be (X, A''). Clearly, N will play X as much as vi and will play A'' with the 
remainder. 

AND(X, Y) 

Wc can add a new node A = AND(X, Y) that will play itself with weight viAv2 in any equilibrium. 
Assemble the OR and NOT gadgets NOT(OR(NOT(A), NOT(y))). 

SUM(X,y) 

Wc can add a new node S = SUM(A, y) that will play itself with weight max(l,vi + ^2) in any 
equilibrium. Create a node Si with preference list {X,Y,Si). Let node 5's preference list be 
{Si,S). Now, clearly node Si will play with weight max(0, 1 — vi — V2), and node S will play 
Si that same amount. So node S will play itself with weight 1 — max{0, 1 — vi — V2)- In other 
words, if V1 + V2 > 1, then S will play itself with weight 1. Otherwise, S will play itself with weight 
1 — 1 + ?;i + i;2 = 'Wi + '^'2, as desired. 

DIFF(X, Y) 

Wc can add a new node D = DIFF(A, Y) that will play itself with weight vi — V2 if f 1 > V2, or 
otherwise in any equilibrium. Create a node Di with preference list (X,Di). Di will play itself 
with weight 1 — vi. Now set the preference list for D to {Di,Y,D). D will play itself with weight 
min(0, 1 — (1 — vi) — ^2) = min(0, vi — ^2), as desired. 

COPY(A) 

We can add a new node C = COPY(A) that will play itself with weight vi in any equilibrium. 
Create a node Ci with preference list {X, Ci). Ci will play itself with weight 1 — vi. Set the 
preference list for node C to (Ci ,C). C will play Ci with weight 1 — vi, leaving weight vi on C. 

DOUBLE(A) 

We can add a new node M = DOUBLE(A) that will play itself with weight min(l,i'i * 2) in any 
equilibrium. Create player Mi = COPY(X) and set M as SUM(X, Mi). 

LESS(A, Y) 

Given e/ (0 < < ^), We can add a new node L = LESS (A, Y) to the game that in any equilibrium 
will play only itself if vi — V2 > e^, and will play Li (for a new node Li) if vi < V2- First 
create D = DIFF(A,y). Then create Mi = DOUBLE(i:)). For z = 1 to -loge;, create player 
Mj-|_i = DOUBLE(Mj). Call the last DOUBLE player node L and the extra player for the sum 
player of the last DOUBLE player node Li. If vi < V2, the DIFF player will return 0, so player L 
will play the result of multiplying by 2 many times, or 0. vi — V2 > ei, player L will play the 
max of 1 and {vi — V2) * 2"'°^^' = (vi — V2) * j-^ > = 1- 

HALF(A) 

We can add a new node H = HALF(A) that will play itself with weight vi/2 in any equilibrium. 
Create a node Hi with preference list (A, i^i). Hi will play itself with weight 1 — vi. Then 
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create two more nodes: H2 and Hj,. Node H2 has preference list (Hi, H^, H2)- Node H3 has 
preference hst {Hi, H, H3). Set the preference hst for node H to be (Hi, H2, H). Each of H, H2, 
and H^ will use its first choice with weight 1 — vi, leaving vi for its other two choices. Then, we have 
wh{H)+wh{H2) = vi, wh2{H2)+wh2{H3) = vi, and wh3{H3)+whs{H) = vi. In any equilibrium, 
it must be true that wh{H2) = wh2{H2), wh2[H^) = WH^iH^), and wh.^{H) = wh{H). Solving 
this gives wh{H) = wh{H2) = wh2{H2) = wn^iHs) = WHsiH^) = WHsiH) = ^. 

As in [12], our LESS player plays the specified action (itself, in our case) with weight 1 if 
vi > V2 + ^i, and plays itself with weight if < V2, but will play some unspecified fraction on 
itself if V2 < vi < V2 + ei- We use the LESS player to extract the bits representing the coordinates 
of a cubelet to be passed into the circuit. This procedure is identical to that of [12]. Let X 
denote the x-coordinate player, and let Xi = COPY(X). For i from 1 through n, we create 
players Bi = LESS(2-*,Xi) and Xi+i = DIFF(Xi, HALFX^j)), where HALF^ indicates applying 
the HALF gadget i times. It can be shown that as long as x is not too close to a multiple of 2~", 
we will extract its n bits correctly. If this is not the case, however, we will not properly extract the 
bits, and our circuit simulation may return an arbitrary value. We resolve this problem using the 
same technique as in [12]: we compute the circuit for a large constant number of points surrounding 
the vertex and take the average of the resulting vectors. Since these details are almost identical to 
that of [12, Lemma 4], we omit them. 

Based on the above gadgets and the framework from [12], we get the following. 

Theorem 3.3. 3-D Brouwer <p Preference Game. □ 
3.5 Approximate equilibria 

Given the hardness of finding exact equilibria in preference games, a natural next question 
is whether it is easier to find approximate equilibria. We define an e-equilibrium of a fc-player 
preference game to be a set of weight distributions wi, . . . , Wk that satisfy the following conditions 
for every player i: (a) '^jWi{j) = 1; (b) for each j, < Wj{j) + e; and (c) for each j, 

either Yle-eyj "^ii^) > 1 — e or \wi{j) — Wj{j)\ < e. The problem of finding an e-equilibrium is 
e- Approximate Preference Game. 

Theorem 3.4. Brouwer <p e- Approximate Preference Game. Thus, it is PPAD-hard to 

find an e-equilibrium for preference games for e inverse polynomial in n. 

Proof. Our proof follows the framework of [8, 9] for proving the hardness of approximating Nash 
equilibria in 2-player games. This framework starts with a high-dimensional discrete fixed point 
problem, Brouwer, which is also PPAD-complete. The input to Brouwer is a Boolean circuit 
that assigns a color from {1, n, n+ 1} to each interior node of an n-dimensional grid {0, 1, 8}". 
This grid has about 2^" cells, each of which is an n-dimensional hypercube. The discrete fixed point 
is defined to be a panchromatic simplex inside a hypercube. This framework of [8, 9] uses a new 
geometric condition for discrete fixed points, which requires that the average of sampled points 
in the interior of the targeted panchromatic simplex is inverse-polynomially close to the zero vector. 
The rest of the proof follows the framework of [12]. 

Our broad definition of an e-equilibrium poses additional technical challenges which did not 
occur in the reductions of [8, 9]. In particular, in the presence of errors, our Boolean gadgets only 
approximately simulate the Boolean operations, while in previous reductions, the Boolean gadgets 
are precise. We prevent magnification of errors in the Boolean simulation by strategically adding 
a LESS gadget to correct errors after each logic step. 
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Wc focus on bounding the errors for the gadgets of Theorem 3.3 and the addition of the extra 
LESS gadgets. Other details closely match those of [8, 9, 12]. 

Let €; (the measure of the fragility of our LESS gadget) be a real number such that e < ef. 
Then, we have the following error bounds. 

Lemma 3.5. Assuming node X plays itself with weight v'l, vi — ei < v'l < vi + ei, and node Y 
plays itself with weight v'2, V2 — ei < v'2 < V2 + ei, each of the boolean gadgets plays itself within 
ib(2e; + 6e) of the correct value for the correct vi and V2 inputs. 

Proof. OR 

If vi and/or V2 is 1, then and/or v'2 is at least 1 — e;, and node R\ will play Ri with weight at 

most €/ + e, so -R will play R with weight at least 1 — e; — 2e. If both vi and V2 are 0, then v'l and 
v'2 are at most e^, and node Ri will play Ri with weight at least 1 — 2e; — 2e, so R will play R with 
weight at most 2ei + 3e. 

NOT 

If t;i = 1, v'l is at least 1 — e^, and node N will play itself with weight at most e; + e. If v\ = 0, v'l 
is at most e/, and node N will play N with weight at least 1 — e; — e. 

AND 

The AND gadget concatenates other new players to get -■(-■wi V -1^2)- Each NOT may add at most 
one additional e error to the given value, and the OR may add up to 3e error (on top of the sum 
of the errors from both inputs) . So the AND player will return a value within an additive 2ei + 6e 
of the correct or 1 answer. □ 

Lemma 3.6. Each of the arithmetic gadgets plays itself within ±5e of the correct value for the 
input it is given. 

Proof SUM 

Node 5*1 will play with weight w{SiT) £ [max{0, 1 — v'l — v'2 — 2e), max(0, 1 — 1;'^ — ^2 + 2e)]. 
So node S will play S with weight ws{S) G [v'l + v'2 — 3e, v'^ + v'2 + 3e], unless wsi{Si) = 0, which 
means -y^ + ^2 > 1 — 2e. In this case, node S will play S with weight at least 1 — e. 

DIFF 

Node Di will play DiT with weight wdi{Di) £ max{0, 1 — v'l — e),max(0, 1 — v'^ + e)]. Node D 
will play D with weight wd{D) € [max{0, v'l — v'2 — 3e),max{0, v'l — v'2 + 3e)], unless wdi{Di) = 
which means v'^ > 1 — e. In this case, node D will play D with weight at least 1 — v'2 — 2e and at 
most 1 — v'2 + e (not 2e because we cannot underfill the strategy with weight 0) . 



COPY 

Node Ci will play Ci with weight at least 1 — v'^ 
with weight at least v'^ — 2e and at most v'^ + 2e. 



— e and at most 1 — v'i + e. Node C will play C 



11 



HALF 

Node Hi will play Hi with weight w^i {Hi) G [1 — v[ — €,1 — v[+ e], and each other player will play 
its second and third preferences with total weight between 1 — whi{Hi) — e and 1 — whi{Hi) + e. 
Each other player will play itself half of this amount plus or minus 3e (this is easy to verify by 
writing the system of inequalities and checking the extreme points). Therefore, node H plays H 

v' v' 

with weight at least ^ — 4e and at most ^ + 4e. 
DOUBLE 

The DOUBLE gadget consists of a copy player, which adds at most 2e error, and a sum player, 
which adds at most 3e error on top of the sum of the errors in the two inputs. Therefore, node M 
plays M with weight at least 2vi — 5e and at most 2vi + 5e. □ 

Lemma 3.7. The LESS player will play itself with weight < e; if it is given v'l , v'^ such that v[ < v'^ , 
and with weight > 1 — e/ if v'l — v'2 > ei. 

Proof LESS 

The LESS gadget inherits its susceptibility to error from its initial DIFF player (which was, in 
the exact equilibrium case, non-zero if and only if vi < V2)- For the case where vi < V2, we can 
account for the errors of the DOUBLE players (used to repeatedly amplify the difference) simply 
by adding extra iterations of DOUBLE. Since we stipulated that e < ef, a value that started < 5e 
will remain < e;, even after doubling enough times to push a value > e; to a value over 1 (including 
extra multiplications to account for the DOUBLE errors). Therefore, the LESS player will play 
itself with weight less than if v'l < v'2 and with weight greater than 1 — e; if v'^ — ei. □ 

Lemma 3.8. By using a LESS gadget after each boolean logic gadget, we can ensure that the output 
from each gate is at most ei away from the correct output. 

Proof. After a single gate (if the inputs are within additive e; of the correct or 1 inputs) , a player 
will play itself at least 1 — 26; — 6e if the correct answer is 1, and at most 2ei + 6e if the correct 
answer is (based on the analysis in the proof of Lemma 3.5). Call this player OUTPUT and the 
value it plays itself v. Then, we only need to add a player CONSTANT-HALF who plays itself with 
weight close to |, and a LESS player, CORRECTION = LESS(OUTPUT, CONSTANT-HALF). 

CONSTANT-HALF can be made up of a player who plays itself with weight at least 1 — e and 
at most 1 (its first preference is for itself) and a HALF player, who by Lemma 3.6 will play itself 
with weight at least — 5e and at most ^ -f- 5e. 

We know that if the correct answer was 0, then V <2ei + Qe < ^ - be, so CORRECTION will 
play itself with weight < ei (by Lemma 3.7) , and if the correct answer was 1 , then v > 1 — 2e; — 6e > 
l + 5e + ei,so CORRECTION will play itself with weight > 1 - (again by Lemma 3.7). □ 

After the corrections, we're left with the following possible errors due to the e-approximation. 
We have small errors in the bit extraction, which arc no larger than the parallel errors in [12] (they 
verify that these small error values will not affect the final result). We also have small errors (at 
most €;) coming out of the circuit. As in [8, 9], we will repeat the circuit a polynomial number 
of times and take the average in order to override any errors from the LESS gadgets in the bit 
extraction. 
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Taking an average of two results requires 3 steps: first we divide each "bit" in half (we cannot 
take the average of the entire values because we have a max value of 1 for any player, so the average 
of two I's would come out to |). Here, we may pick up 4e of error for each of the two results. Then, 
we sum the two. The total error so far is at most lie. Finally, we take half of the sum, which also 
divides the error in half, but may add up to an additional 4e of error, for a total additional error 
of at most 9.5e from taking the average of 2 results. 

We can add LESS gadgets periodically during the averaging and during the final OR, AND and 
NOT of the results to keep our total errors under e/. In other words, if this is a solution vertex for 
Brouwer, then we will have 6 players, each playing at most e/. If this is not a solution vertex, 
then at least one of the 6 players will play at least 1 — e/. 

Suppose we have an e-equilibrium in this game, and the x-coordinate player is playing value 
X. This is a SUM player, and the extra player from the SUM gadget must be playing between 
1 — X — e and 1 — ,t + e. Tlicr(;forc, the sum of the two values it is adding (a copy of the coordinate 
player and the feedback NOT player) must be between x — 3e (if this player overfills each of its 
top strategies by e) and a; + 3e (if this player underfills each of its top strategies by e). We know 
that the copy player must be playing the same value as the coordinate player to within 2e (between 
X — 2e and x + 2e) . Adding this range to a number > 1 — cannot possibly give something in the 
range [x ~ 3e, x + 3e] , so the feedback player must be playing a value at most ei on itself (since we 
know the feedback player will play either a value < or a value > 1 — e;), and the correct feedback 
must be 0, so this is a valid fixed point. 

□ 

3.6 Constant degree preference games 

For a given preference game, define in(u) (resp., out(f )) of a player v to be the set {u : v u} 
(resp., {u : V u}). We define the in-degree (resp., out-degree) of a player v to be |in('u)| (resp., 
|out(t;)|). The degree of the player is defined to be the sum of the in-degree and the out-degree of 
the player. The in-degree (resp., out-degree, degree) of the preference game is defined to be the 
maximum, over all nodes, of the in-degree (resp., out-degree, degree) of the node. Notice that this 
is the same as the degree in a directed graph in which each player is represented by a node, and an 
edge from u to v means that u prefers v over itself. DEGREE d PREFERENCE GAME is the problem 
of finding an equilibrium in a preference game with constant degree d. 

Notice that the players defined in Section 3.4 all have out-degree at most 2. There is no implicit 
constant bound on the in-degree, but by adding COPY gadgets (which have out-degree 1) we can 
guarantee in-dcgrcc at most 2. Furthermore, since COPY gadgets have out-degree 1, we can make 
sure that the overall degree of the preference game is at most 3. This automatically implies that 
it is PPAD-hard to find an equilibrium even in a preference game with degree 3. We will use 
this fact in later sections, where we show PPAD-hardness of several other problems via reductions 
from constant degree preference games. In addition, we have the following reduction. 

Theorem 3.9. PREFERENCE Game <p Degree d Preference Game 

Proof. Given a preference game over player set [n] = {1, . . . , n}, with the sum of the lengths of the 
preference lists equal to m. Assume that each player exists in the preference list (ahead of "self" ) 
for at most m' other players. 
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Reducing to a preference game with constant out-degree (at most c + 1), with 0{m + n) 
players. 

Suppose player i in the original game has preference list ji,j2, ■ ■ ■ ,jk- Let d = [|] . Create 2d new 
players, spht into two sets: I = {ii, . . . , i^} , I' = {i'l, ■ ■ ■ , i'^}- For ease of notation, we will also refer 
to player as i*, since this is the player that will play itself the same amount that the original 
player i should play itself. 

Set the preference Ust for the new player ii to ii, J2, • • -jtiH- For new player ih {h > 1), set 
the preference list to i'^-v jlh-i)c+v ^{h-i)c+2' ■ ■ -^fhc^^h- For each new player i'^ {h > 1), set the 
preference list to 

Equilibrium in the original preference game maps to an equilibrium in the new pref- 
erence game. 

The map will be as follows: Suppose we are given weights w{i,j) for the original game, where 
w{i,j) is the weight player i puts on player j. We will set the weights w* in the new preference 
game as follows. Again, assume the preference list for player i in the original game is ji,j2, ■ ■ ■ ,jk- 

• w*{ih,j*) = w{i,j) for all j* in the preference list of ih- 





_ ^(h-i) 
— 1^1=1 




• w*{ih,ih) = 


^ 2^1=1 


w{i,ji) 


• ^*ii'h^ih) = 


1 - Ef=i 




• ^*ii'h^i'h) = 






Notice, 






W [l ,1 ) = 


w*{id,id) 


(by definit: 



dc 

= 1 — ^^2iW{i, jl) (from map above) 

1=1 

= 1 — w{i,ji) (by definition of d) 
1=1 

k 

= 1 — w{i,ji) (we can ignore the [] since the pref list stops after k items) 
1=1 

= w{i,i) 

In order to verify that this is an equilibrium in the new game, we must check the following 

1. w*{i,j) < w*{j,j) for all 

2. w*{i,i) + ^j^iW*{i,j) = 1 for all i. 

3. If w*{i,j) > 0, and if i prefers a over j, then w*{i,a) = w*{a,a). 

All three of these are trivial for players in I', so we will verify the conditions for players in /. 
First consider condition 1 for each weight placed by a player in set /. 



14 



• w*{ih,a*) = unless a* is in the preference list for ifi. If a* is in the preference list, then 
a* = a'p for some player a from the original game with p = \ length of a's preference list /c] , 
and w*{a*,a*) = w{a,a). By the map above, w*{ih,a*) = w{i,a). Since w{i,a) < w{a,a), 
w*{ih,a*) obeys condition 1. 

• w*{ih,i'h_i) = But weknowfromthemapthat«;*(4_;^,i'^_J = Ylit'i^^'' '^ihjl)^ 
so w*{ih,i'f^_i) also obeys condition 1. 

Next, check condition 2 for each player in set /. The total weight placed by player is 
'w*{ih,ih) +'w*{ih,i'h-i) + XI 'w*i'i-h,f) 

j* in the pref list of ih 

he (/i-l)c 

= l-^w{i,ji)+ w{i,ji)+ X w{i,j) 

1=1 1=1 j* in the pref list of i/j 

he he 

= 1- w{i,ji)+ Y 

l={h-l)e+l l={h-l)c+l 

= 1 

Finally, check condition 3. From above, we know that w* {ih,i'i^_i) = w* {i'fi_i,i'fi_i), so the first 
element in each preference list in the new game (the first preference of ih is for will always 

obey w*{i,a) = w*{a,a). Also from above, w*{j*,j*) = w{j,j) and tv*{iii,j*) = w{i,j). Therefore, 
if any lower preference disobeys w*{i, a) = w*{a, a), then it must also be true that w(i, a) ^ w(a, a). 
Since we assumed the w values were an equilibrium in the original game, this must mean that there 
is no b preferred less than a with w{i, b) > 0, so for all b* preferred less than a*, w*{ih, b*) = 0. 

Equilibrium in the new preference game maps to an equilibrium in the original pref- 
erence game. 

This map is simple. Given weights w* in the new preference game, create weights w in the original 
preference game as follows. 

• w{i,i) = w*{i*,i*) 

The max in the first rule is a notational shortcut, since only one of the ih players will have any 
preference for j*, and therefore at most one of the players will have w*{ih,j*) > 0. 

As before, we need to show the following to verify that this is an equilibrium in the original 
game. 

1- w{i,j) < w{j,j) for all 

2. w{i,i) + j) = 1 for all i. 

3. If w{i,j) > 0, and if i prefers a over j, then w{i, a) = w{a, a). 



15 



To show condition 1, consider players i and j. Let = the player in the new game that has j* 
in its preference list. Now, w{i,j) = w*{ih,j*) and w{j,j) = w*{j*,j*). Since w* was feasible, we 
know that w*{ij,j*) < w*{j*,j*), as desired. 

Next, to show condition 2, consider player i. w{i, i)+Ylx=i ^ihjx) = ,i*)+Y^^x=i max/j w*{ih,jx)- 
Let's compute w*{i*, i*) in the new preference game. Recall, the preference Ust for player ih is 
j{h-i)c+v i(*/i-i)c+2' • • •' ^hc^ ^h, and specifically, the preference list for i* (= id) is j*d-i)c+v 
J((i_i)c+2' ■ • ife' ^d- Thus, 

k 

w*{i*,i*) = l-w*{id,i'd-i)- '^*(id,j*x) 

x={d-l)c+l 
k 

x={d-l)c+l 
k 

= 1 - [1 - w*{i'd_i,id-i)] - Y in&xw*{ih,jl) 

x={d-l)c+l 

k 

= w*{i'd_i,id-i) - V maxw*(4,j*) 

x={d-l)c+l 
k 

= w*{id-i,id-i) - X] {^h, fx) 

x={d-l)c+l 

{d-l)c k 

= l-[w*{id-l,i'd-2)+ X] - X ^^'^*i'^h,jx) 

x={d-2)c+l x={d-l)c+l 
(<i-l)c k 

= 1 -'«^*(^d-2>^d-2) - X maxw;*(4,j*) - X maxw;*(4,j*) 

a;=(d-2)c+l a;=(d-l)c+l 

= 1 - w^*(4-2>^d-2) - X max^*(^h'Jx) 

a;=(d-2)c+l 

A: 

= 1 - 'u;*(i'i,i'i) - V raaxw*{ih,j*) 

x=c+l 

k 

= 1 - [1 - w*{i[,ii)] - V maxu;*(4, j*) 

— , " 

x=c+l 

k 

= w*{ii,ii)- X T^^i^*iih,jx) 

x=c+l 
c k 

= 1 -X^*(^l'-^'^) ~ X ^^^*i'^h,jx) 



x=l x=c+l 



16 



= 1 - Vmaxw*(i,i,j*) - V maxw;*(4, j*) 
— ■ n "—^ , h 

x=\ x=c-\-\ 

k 

= 1 -^maxw*{ih,j*) 

x=l 



Putting this back into our sum for player i, we get 

k k 

+ y]"^(^>Ja;) = W*{i*,i*) + y2^F^'^*i'>'hJx) 
x=l x=l 

k k 

= 1 - Vmaxu;*(i,j,j*) + Vmaxu;*(z,j,j*) = 1. 

' h ^—^ h 



x=l x=l 

So 2 holds. 

Finally, we need to verify if w{i,j) > 0, and if i prefers a over j, then w{i,a) = w{a,a). If 
w{i,j) > 0, then max/j w*{ih,j*) > 0. Let h = the h that satisfies max/j w*{ih,j*)- Now, if i prefers 
a over j, then either (Case 1) ih prefers a* over j* or (Case 2) there is some b < h such that ih 
has preference for a*. Start with Case 1. Since we know that w* is an equilibrium for the new 
preference game, it must be true that w*{ifi,a*) = 'w*{a*,a*), so w{i,a) = w{a,a), as desired. 

For Case 2, since w*{ih,j*) > 0, we know that for all b < h, w*{i'jj,i'jj) < 1 (otherwise, for 
all c > b, ic would put weight 1 on i^-i) leaving no weight left for itself, so i'^, would also be 
1. Therefore, ih would put weight 1 on ih-i, leaving no weight for j*.) Therefore, for the b 
with preference for a*, tt;*(i^,i^) < 1 ^ u)*(i'j,,i6) > ^ 'w*{ib,ib) > 0. Therefore, for all c* 
in the preference list for it, (including a*), w*{ib,c*) = w*{c*,c*). So w*{ib,a*) = w*{a*,a*), so 
w{i,a) = w*{ib,a*) = w*{a*,a*) = w{a,a), as desired. 

Reducing to a preference game with constant in-degree (at most 2), with 0{m'n) 
players. 

Suppose wc have a player i who exists in the preference lists of m' other players: ji, j2) ■ • • ; Jm'- We 
will add extra players i'^, ii, • • • i i'm'^^m'- The preference lists for these new players will be: i'^ 
has list for all > 1: i'^ has list (zfc_i,i'^), for all k, ik has list {i'i^,ik)- If i plays itself with 

weight V, then i'^ will play itself with weight 1 — v and ik will play itself with weight v. Each of 
these new players has in-degree 1 and out-degree 1. Now, we can replace i with i^ in the preference 
list for jfc, so that i now has in-degree 1 and each i^ has in-degree 2. This does not affect the degree 
of any jk- □ 

4 Personalized Equilibria 

In this section, we introduce a new notion of equilibrium for matrix games, in which a player 
may individually match her strategies to her opponents strategies without obeying a product distri- 
bution. Since this equilibrium allows different players to simultaneously choose different matchings 
across the strategies, we call this a personalized equilibrium. In Section 4.2, we characterize the set 
of all personalized equilibria in a fe-player game. In Section 4.3, we show that finding a personalized 
equilibrium is PPAD-complete. 
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Suppose we are given a A;- player matrix game between players l,...,k. Each player i has 
strategy set Si. We are also given a utility function for each i specified by : £" ^ M, where 
E = Y\j Sj. Now, given probability distributions Pj{Sj) for each j ^ i, a, best response for player i 
(when using traditional Nash payoffs) is defined by the Pi{Si) that satisfies the following, where w 
is a weight function over e E E. 

max w{e)ui{e) 

tt;(e) = Pj{s) for all e £ £^ 

seenSj 

w{e) > for all e e -E 

The correlator in a correlated equilibrium [3] relaxes the requirement that u; be a product dis- 
tribution; however, w docs satisfy, among other conditions, the projection constraint ^g.^ge ^^(e) = 
Pj{s) for all s G Sj,l < j < k. For a personalized equilibrium, we further relax this by allowing 
each player to define her own weight function, Wi, so that in the best response of player i, Pi{s) 
(and Wi{e)) satisfy the following. 

max Wi{e)ui{e) 

eeE 

Wi{e) = pj{s) seSj,l<j<k 

e:s&e 

Wi{e) > eeE 

We can view a matrix game as a hypergraph with nodes V = LijSj and edges E = Y[j Sj. Then, 
if we interpret the Pj{s) values as capacities on the nodes and the utility function for player i as 
weights on the edges from the perspective of player i, a personalized equilibrium is simultaneously 
a maximum- weight fractional hypergraph matching for each player. 

The description of the game above is exponential in the number of players since we require 
that every edge connects one strategy of each player. To allow for more succinct descriptions, we 
generalize the game as follows. For each player i, we introduce a hypergraph with nodes V = DjSj 
and edges Ei. The set Ei is required to satisfy two conditions (that are satisfied by E): (i) for 
each e in E^ and player j, e contains at most one element of Sj; (ii) there do not exist distinct e 
and e' in Ei such that e C e'. In the game, player i places a weight Wi{e) on each edge in E^. A 
player must still place a total of weight 1 on all her edges, and all weights must be non-negative. 
Since the edges of Ei may not connect all players, however, we relax the projection constraint to 
X^e-see^*(^) — Pji^)- Thus, the collection of weights Wi{e), e G Ei, and probability distributions 
Pi{s), s G Si, over all players i, form a personalized equilibrium if for each i, Wi{e) and Pi{s) 
maximize X^gg^j 'Wi{e)ui{e) subject to the following constraints. 

Wi{e) < pj{s) Vs G S'j, Vj / i (1) 

e:s6e 

Y^Wi{e) =Pi{s) \/s e Si 

e:s6e 

Wi{e) > yeeEi 
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Personalized Equilibrium: Given players l...k, strategy set Si, edge set Ei, and utility 
function itj : — >■ M for each player i. Find a probability distribution pj : — > M and a weight 
assignment Wi : ^ M. for each player i that obeys the constraints of LP 1 and maximizes 



Just as mixed Nash equilibria exist for every matrix game, we show that every game thus defined 
has a personalized equilibrium. 

Theorem 4.1. For every multi-player matrix game, a personalized equilibrium always exists. 

Proof. Given the matrix game G, we construct the A;-player game Q in which the ith. player's 
strategy space is the set of all probability distribution functions over Si and the payoff is given 
by the personalized payoff function defined above. We can view the strategy space as the set 
of probability distribution functions over Si instead of weight assignments to Ei since a weight 
assignment uniquely defines a probability distribution function, and since the payoffs and responses 
of the other players only depend on the Pi{s) values, not on the Wi{e) values. Then a personalized 
equilibrium of G is equivalent to a Nash equilibrium of Q. By [38, Proposition 20.3], a game 
has a pure Nash equilibrium if the strategy space of each player is a compact, non-empty, convex 
space, and the payoff function of each player is continuous on the strategy space of all players and 
quasi-concave in the strategy space of the player. The set of probability distributions over Si is 
clearly nonempty, convex, and compact. Furthermore, given probability distributions pi over Si, 
1 < i < k, the payoff for any player i is simply the solution to the following linear program with 
variables Wi{e), over e E Ei. 

max Wi{e)ui{e) 

^ Wi{e)<pj{s) seSj,l<j<k 

Wi{e) = 1 Wi{e) > ee E 

eeEi 

It is easy to see that the payoff function is both continuous in the probability distributions of 
all players, and quasi-concave in the strategy space of player i, thus completing the proof of the 
theorem. □ 

We define PERSONALIZED EQUILIBRIUM as the problem of finding a personalized equilibrium 
in a given matrix game. A;-Personalized Equilibrium is the same problem in a game with k 
players for constant k. Note that the traditional definition of a graphical game [26] may be used in 
this setting with smaller edges. In o!-Graphical Personalized Equilibrium, each player i has 
a neighborhood Ni of at most d other players, and all edges defined for player i are in HjeiV ^j- 
Finally, we define e- Approximate Personalized Equilibrium as the problem of finding a set 
of weight assignments {wi{e) > is the weight assigned by player i to edge e) such that (a) for 
every player i, 1 — e < ^eU'i(e) < 1, (b) for each player pair i and j, and for each strategy s, 
l^g.^.gg mj(e) — -sge ""^iC^) I — ^' ^^"^ i'^) ^'^^ t>est response weight assignment for any 
player i, J2e^ii^)M(^) - Z)e ^ 
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4.1 Characterizing personalized equilibria in two player games 

We can simplify the definition of personalized equilibria when discussing two player games. 
Consider a matrix game {R, C) between two players ROW and COLUMN, in which player ROW 
has strategies ri, r2, . . . ,rm and player COLUMN has strategies ci, C2, . . . , c„. i? G j^mxn 
payoff matrix of ROW, and C G M"^^" is the payoff matrix of COLUMN. 

Like a standard bimatrix game, if player ROW selects and player COLUMN selects Cj, the 
payoff to ROW is R[i,j] and the payoff to COLUMN is C[i, j] . Suppose ROW selects a distribution x 
among the strategies {ri, r2, . . . , r^}, and COLUMN selects a distribution y among {ci, C2, . . . , c„}. 
Unlike payoffs defined for mixed strategies, in which the payoff to ROW is ^ j] and 

the payoff to COLUMN is J2i j x[i]y[j]C[i, j], we define the payoffs using flows. The payoff to ROW 
is: 

Payoff (ROW) = max V UijR[i, j] (2) 

■ ■ 

subject to ^Ujj = V? and ^Ujj = y[j], Vj; 

3 i 

Payoff (COLUMN) = max V VijC[i, j] (3) 

1,3 

subject to ^Wjj = a;[i], Vz and ^Vij = y[j], Vj. 



In other words. Payoff (ROW) is the cost of a 1-unit min-cost flow from source r to destination c 
in the directed graph Gr = (Vr, Eh), with 

Vr = {r,c,ri,r2,...,rm,ci,C2,...,Cn} 

Er = {(r ^ n), U {{n ^ Cj), U {{cj ^ c), Vj}, 

where the capacity of edge (r ri) is x[i], the capacity of edge {cj — > c) is y[j], and the capacity 
of all other edges is +oo. The cost of edge (rj cj) is —R[i,j], and the cost of all other edges is 
0. We note that for any distributions x and y, a unit-flow from r to c always exists, so the above 
payoff function is well-defined. 

Similarly, Payoff (COLUMN) is the cost of a 1-unit minimum-cost flow from source c to desti- 
nation r in the directed graph Gc = {Vc, Ec), with 

Vc = {r,c,ri,r2, . . . ,rm,ci,C2, . . ■ ,Cn} 

Ec = {(c ^ Cj), Vj} U {{cj ^ n), V?;,i} U {{n ^ r), Vi}, 

where the capacity of edge (c — > Cj) is y[j], the capacity of edge (rj — > r) is x[i], and the capacity 
of all other edges is -|-oo. The cost of edge {cj — > r^) is —C[i,j], and the cost of all other edges is 0. 

It is not hard to show that the set of all two- player personalized equilibria is convex. In fact, 
we can give a stronger characterization, which will lead to a polynomial time algorithm. 

Theorem 4.2. A 2-player personalized equilibrium can always be found in polynomial time. 

Proof. Let graph G = the union of Gr and Gc. We will now consider a subgraph G' = {V , E') C G, 
such that V = VrD Vc, {ri Cj) G Er is in E' if and only if R[i,j] > R[i',j] for all i', and 
{cj — >• ri) G Ec is in E' if and only if C[i,j] > C[i,j'] for all f . 
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Any directed cycle in G' corresponds to a personalized equilibria. Consider any cycle 
{ni, Cji, rj2, Cj2, . . . ,rii,Cii} in G', each node played with weight j. Player ROW can match each 
of his strategies r^fc with player COLUMN'S strategy cjk- Since this is a best response for player 
ROW, ROW cannot do better by changing to another strategy. Similarly, player ROW can match 
each of his strategies Cjk with player ROW's strategy rj(fe+i) for ^ < ^ Cji can be matched with rn. 

Every personalized equilibria is a linesir combination of cycles in G'. Starting with any 

bipartite graph from G' in which the in-degree equals the out-degree of each node (a characteristic 
of any personalized equilibria), we can remove any cycle (which is a personalized equilibria) and 
we are still left with a bipartite graph with the same characteristic. □ 

4.2 Characterizing personalized equilibria in fc-player games 

We have shown that the set of all personalized equilibria for a two-player game is just the set 
of all linear combinations of cycles in an appropriately defined graph, which is easy to compute 
in polynomial time. However, for k player games {k > 3), we will give a reduction from finding 
an equilibrium in a preference game to finding a personalized equilibrium in a A; player game (for 
k > 3), thereby showing that finding personalized equilibria is PPAD-hard. Nevertheless, we 
are able to give a concise characterization of the set of all personalized equilibria for arbitrary 
multi-player games. 

Theorem 4.3 (Personalized Equilibrium Characterization). The following program represents the 
set of all exact personalized equilibria. The variables are Wi{e), the weight placed by player i on 
edge e, E Ei. 

J2 ^*(«) - ^e&Ej-.s&e ^i(e) seSj,l<j,i<k (4) 
eeEi-.see 

^ Wi{e) =1 l<i<k 

eeEi 

Wi{e) >0 1 < i < k,e £ Ei 

mm Wi{e) = for all players i and subsets F C Ei such that LP (5) is feasible. 

The following linear program, is defined for each player i and F C. E^ ( referred to as an improvement 
setj. The variables are 5{e) for each edge e € E^. 

Y,5{e)ui{e) >0 (5) 

<5(e) =0 seSj,l<j <k,j^i 

5(e) < (e G F) 
5{e) > (e ^ F) 

Before formally proving this theorem, we will start with some intuition about why this charac- 
terizes all equilibria, here we provide some intuition. The first two constraints of program 4 specify 
a feasible weight assignment, and the first two constraints of LP 5 specify feasible "weight changes" 
that would increase the payoff for player i. How do we know that checking this for all subsets of 
edges is enough to find any possible improvement, and how does the last constraint of program 4 
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ensure that no improvement is possible? We can think of the 5 vahics found in any solution to LP 
5 as an "improvement direction." This is a vector that is orthogonal to the vector of all I's and has 
a positive dot product with the utilities of i. In other words, if player i were to move weight in this 
direction, her payoff would improve. Of course, there may be a continuum of such improvement 
directions. However, there are most an exponential number of negative supports, or "improvement 
sets". These are exactly the F values for which LP 5 is feasible. Given an improvement set, the 
associated player can get a higher payoff by removing weight from all of those edges and adding 
them instead to edges with positive S value. This improvement will be possible unless the player 
does not have weight on this entire improvement set; that is, unless miuggi? u;j(e) = 0. 

Proof. A solution to the program is an exact personalized equilibrium. Assume we have a 
solution to Equation 4 that is not a personalized equilibrium. The first two constraints ensure that 
our solution is a feasible weight assignment for the game. Therefore, there must be some player 
i who is not playing a best response. Take some better response, in which player i plays weights 
w*{e), and let (5(e) = w*{e) — Wi{e). 

Let F be the subset of Ei such that 5{e) < (that is, player i puts more weight on each 
edge in F in the original response than in the best response). Since w* has a strictly higher total 
utility for player i than Wi, we know that X^eeB; > SeeEj which implies that 

J2e£Ei <^(6)^i(c) > 0. Since both Wi and w* were feasible weights, it must be true for any strategy 

S that J2e:seeMe) = Ee:see<(e) ^ J^e-.see^i^) = 0- 

By our definition of F, 6{e) < for all e G _F and (5(e) > for all e ^ F. Therefore, F 
and i obey all the constraints of linear program 5, so since Wi{e) obeyed program 4, we know 
that mine^F Wi{e) = 0. Thus, there exists some edge f & F such that Wi{f) = 0. But then 
> (5(/) = w*{f) — Wi{f) = w*{f), contradicting the fact that w* was a feasible best response for 
player i. 

Any personalized equilibrium is a solution to the program. Assume we have a personalized 
equilibrium that does not satisfy some constraint of the program. Let Wi{e) be the weight placed 
by player i on edge e in this equilibrium. The first three constraints are the definition of a feasible 
weight assignment. Therefore, assume this equilibrium does not satisfy the min constraint for some 
player i and some subset F C Ei for which LP 5 is feasible. 

Consider a solution 6 for LP 5 for this i and F. Let M = "'"^^-^ 'T;^/'^,^! , and let 6'(e) = 6(e) ■ M. 

maxegij- |d(e)| ' \ J \ J 

M is a well-defined positive number since (1) the min constraint was not satisfied, and (2) LP 5 
specifies that (5(e) < for all e e F. We know that F is non-empty because the first constraint 

implies there is some 5 > 0, and combining this with the second constraint implies there is also 
some (5 < 0. Furthermore, for all e with (5(e) < (i.e., for all e G F), \5'{e)\ < Wi{e). Now, 
consider the alternate assignment for player i specified by w*{e) = Wi{e) + S'{e). By the second 
constraint of LP 5 and the fact that |<5'(e)| < Wi{e) for all e with (5(e) < 0, this is still a valid weight 
assignment. By the first constraint of LP 5, this gives a strictly higher total utility for player i. 
Therefore, weights Wi{e) did not give a best response for player i, so we did not have a personalized 
equilibrium, contradicting our assumption and completing the proof. □ 

Corollary 4.4. For any matrix game with all rational payoffs, there exists a personalized equilib- 
rium in which the probability assigned by each player to each strategy is a rational number. 

Proof. In Theorem 4.3, we showed that any personalized equilibrium is a solution to a linear 
program plus additional min constraints, in which all coefficients are rational. By Theorem 4.1, this 



22 



program has at least one solution. Now, we can rewrite this as a union of many linear programs as 
follows. Let Fi, . . . ,Fcthc the set of all improvement sets. We can write OiLi linear programs, 
each consisting of the first three constraints from program 4 as well as the a constraints [ei = 
for some ei G Fi], [e2 = for some 62 G F2], . . ., [ea = for some Ca in Fa]. We can create one 
LP for each such combination of one edge from each improvement set, or Y\'i^i \Fi\ LPs. Since the 
union of these linear programs is exactly the same as the program in Theorem 4.3, and since (by 
Theorem 4.1) the program in Theorem 4.3 has at least one solution, we know that at least one of 
these linear programs has a solution. Any feasible LP with rational coefficients will have a rational 
solution. Therefore, there will be a personalized equilibrium with all rational weights. □ 

4.3 Finding personalized equilibria is PPAD-complete 

This section contains four reductions. First, we reduce Degree d Preference Game to d- 
Graphical Personalized Equilibrium. We next reduce 3-Graphical Personalized Equi- 
librium to 4-Personalized Equilibrium. It can be easily verified that the same reductions can 
be used to show e- Approximate Preference Game <p e- Approximate Personalized Equi- 
librium. These reductions together show that finding an e-approximate personalized equilibrium 
in both graphical games and 4-player games is PPAD-hard. 

Theorem 4.5. Preference Game <p Personalized Equilibrium 

Proof. Given a preference game over player set [n], with the preference lists specified as a set of 
values Qij for all i,j G [n]: Qij = the number of players k such that j k i. 
Define a game as follows, in which we will find a personalized equilibrium. 

• The set of players = {pi, . . . 

• Si (the set of strategies for player pi) = {sij : Qij > 0} 

• Hi = the set of hyperedges for player pi = {{sjj, SjjYisij G Sj, j 7^ i} U {sjj} 

• Ui{{sij, Sjj}) (the payoff to player i for this hyperedge) = Qij 

• Ui{{sii}) = Qii>l 

Notice that the degree of the game is preserved, and the number of edges defined is at most n 
times the degree. 

A personalized equilibrium maps to an equilibrium in the preference game. 

The map will be as follows: Suppose we are given weights xij for each player i and edge {sjj, Sjj}, 
and Xii for player i and hyperedge {so}. These weights form a personalized equilibrium. We will 
set weights Wij = Xij in the preference game. 

To show this is an equilibrium in the preference game, we must show the following. 

• For all i, Yjj '^ij = 1- 

Ylij ''^ij = ^ij = 1) since this is a valid solution to the personalized game. 

• For all i,j, Wij < Wjj. 

Wij = Xij < Xjj (by the projection constraint for personalized equilibria), Xjj = Wjj. 
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u> is a lexicographically maximal weight assignment. 

Suppose this is not true. Then, there exists another weight assignment w' that is lexicograph- 
ically larger than w. Let w' be the lexicographically maximal such assignment. Thus, there 
exist i,j such that T.k:Qik>Qij ^'ij > T.k:Qik>Qii ^H- ^^^^ i, take a j with the largest 
Qij that meets this condition. By our definition of j and the fact that w' is lexicographi- 
cally maximal, we know that for all / with Q^, > Qij, Y.k:Qik>Qi^, Kj = T.k:Qik>Qi^, ^^r 
Let 6 = Y.k:Qik>Qij K ~ ^k:Qik>Qij > consider the payoff to player i in the 

personalized game. 

Payoff to z = y^^XjiQii 

I 

= XiiQii + ^ XiiQii + ^ XiiQii 

= X] '^ilQil + Qij XI + X '^ilQil 

^'•Qil ^Qij ^'Qil — Qij I'-Qil '^Qij 

= X '^'ilQil + Qij X + X '^ilQil 

l:Qil>Qij l-Qil=Qij l-Qil<Qij 

l:Qil>Qij l-Qil=Qij l-Qil<Qij 

X "^'ilQil + Qij X '^'il ~ ^^^j + X "^i'^'' + ^^Q^j ~ 

^'•Qil ^Qij ^-Qil — Qij ^'Qil "^Qij 

X '^'il^il + X "'i' ~ ~ 1) + X + - 1) 

^'•Qil ^Qij ^-Qil — Qij I -Qil "^Qij 

l:Qii>Qij l-Qu=Qij l-Qii<Qij 

^'w'iiQii 



< 



< 



So player i would do strictly better by playing x = w', leading to a contradiction. 



An equilibrium in the preference game maps to a personalized equilibrium. 

Suppose we are given weights Wij forming an equilibrium in the preference game. We will set weights 
in the personalized game as follows, xih = Wij for player i and edge h = {sij,Sjj}. xih = wu for 
player i and edge h = {su}. 

To show this is a personalized equilibrium, we must show the following. 

• For ah i, Yjh^ih = 1- 

Ylih ^ih = X^j "^ij = 1) since this is a valid weight assignment in the preference game. 

• For all i.Sjk e Sj, T^h-.s^ueh^ih < Eh-.s^keh^jh- 

If j + k, J2h:sjkeh^ih = < 'Eh:s,,eh^ij- 3 = ^' J2h:sjjeh ^ih = ^ih' where h' = {sij,Sjj} 
= Wij < Wjj = Xjh" where h" = {sjj} = J^h-.saeh^jh- 
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X is a best response in the personalized game for all players i. 

Consider any other weight function x' for the personalized game. Since there is a one-to-one 
mapping from defined edges to i,j pairs in the preference game (including i = j), we can 
define a new weight function w' in the preference game using the same rules as defined in 
the first half of this proof {w'ij = x'^j). We know that w is lexicographically maximal for the 
preference game. Using the same reasoning as above, we get: 



Payoff to i playing x' = x'^iQi 



l:Qii>Qij l'Qii=Qij l-Qii<Qij 

< X '^ilQil + Qij X + X ^ilQil 

I 

= Payoff to i playing x 



□ 

Corollary 4.6. It is PP AD -hard to find a personalized equilibrium, even in a graphical game with 
degree 3. 

Proof. The reduction in the proof to Theorem 4.5 preserves the number of players. For player i, it 
creates one hyperedge of size at most 2 for each player in out(i) in the preference game. Therefore, 
the degree in the game is preserved. □ 

Theorem 4.7. 3-Graphical Personalized Equilibrium <p 4-Personalized Equilibrium 

Proof. Suppose we are given a graphical game with degree 3 for which wc want to find a personalized 
equilibrium. We first convert this graph so that it still has degree 3 but also obeys the following 
property: For each node u with at least two outgoing edges, one to node vi and the other to node 
V2, there exists either an edge from vi to V2 or an edge from V2 to vi. 

Given a graph with maximum degree 3, we make the following modifications to satisfy the above 
property. Suppose we have a node u with an edge to vi and an edge to V2 , and suppose vi already 
has degree 3. To fix this, we will create an extra node v'^ with the same strategies as vi which will 
play exactly the same weights as vi in an equilibrium. We can do this by setting the payoff to v'^ 
for agreeing with vi to 1, and the payoffs for disagreeing with vi to 0. has out-degree 1, since 
it only depends on vi. We have added one to the in-degree of vi. However, now we can replace 
edge (u, Vi) with edge (u, v'^), so v\ now has degree 3, as originally, and v'-^^ has degree 2, so we can 
add an edge between v'-^^ and V2 without exceeding the degree requirement on vi. Repeating the 
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above transformations with other vertices that violate the desired property will lead to a degree-3 
graphical game that satisfies the property. 

Now we have a degree 3 graph with the desired property. Create a 3-coloring and create one 
player per color. Each player takes each of the strategies for each node in that color. For ease of 
notation, assume that each of the original nodes had only 2 strategies. This can be easily adjusted 
for more strategies. Add dummy strategies as necessary so that each of the 3 players has the same 
number of strategies. Also add a fourth player with half the number of strategies as any other 
player. 

This gives us 4 players. Let the strategies for player 1 be {aiQ,aii,a2o,a2i, ■ ■ ■ ,cifeO)flfei}- The 
strategies for player 2 are {6io, . . . , 6^0, ^fci}- The strategies for player 3 are {cio, cn, . . . , c^o, Cfci}. 
The strategies for player 4 are {di,d2, ■ ■ ■ , dk}- 

Next we will assign payoffs for each hyperedge. Start by giving each hyperedge the same payoff 
as in the graphical game (we can do this because no two nodes influencing the same strategy are 
strategies of the same player). Notice that these payoffs will not depend at all on player 4. All of 
player 4's payoffs start at 0. Let Pi{w, x, y, z) = the payoff to player i if player 1 plays w, 2 plays 
X, player 3 plays y, player 4 plays z. Now we want to add to these payoffs in order to ensure that 
each player plays each strategy pair equally. 

Let M be strictly greater than the largest payoff so far. Now, change the following payoffs: 

pi{asi,x,y,ds)+ = M (player 1 is playing either strategy from the node numbered s, player 4 
is playing his s*'* strategy). 

P2{w,bsi,y,ds)+ = M (player 2 is playing either strategy from the node numbered s, player 4 is 

playing his ■s*'* strategy). 

P3{'w,x,Csi,ds)+ = M (player 3 is playing either strategy from the node numbered s, player 4 is 
playing his s*'* strategy). 

P4{asi,x,y,d(^g^i-))+ = M (player 1 is playing either strategy from the node numbered s, player 4 
is playing strategy s mod A; + 1). 

If fi{x) = the amount player i plays strategy x then in any equilibrium we must have (for all s) 

/i(aso) + /i(asi) = fiids) 

f2{bso) + f2{bsl) = k{ds) 

h{cso) + h{Csl) = fiids) 

/4(4) = /i(a(,._i)o) + /i(a(^_i)i) for 1< s < A; 

/4(di) = /i(ajko) + /i(afci) 



These equations imply that: 

/i(oso) + /i(asi) = /i(a(^_i)o) + /i(a(s_i)i) for s > 

/i(aoo) + /i(aoi) = fi{ako) + /i(ajfci) for s > 

f2{bso) + f2{bsi) = /i(aso) + /i(asi) 

fsicso) + fsicsi) = /i(aso) + /i(asi) 



In other words, given a personalized equilibrium in this game, we can simply multiply by the 
number of pairs (nodes) per player to get a personalized equilibrium in the graphical game. □ 
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The remaining two reductions will be used to show PPAD membership of Personalized 
Equilibrium. We show how to reduce Personalized Equilibrium to e-AppRoxiMATE Per- 
sonalized Equilibrium, as long as e is sufficiently small. Finally, we reduce e- Approximate 
Personalized Equilibrium to End of the Line, thereby completing the proof that finding 
personalized equilibria (as well as e-approximate personalized equilibria) is PPAD-complete. We 
start with an LP compactness claim that will be useful to show PERSONALIZED EQUILIBRIUM <p 
e-AppROxiMATE Personalized Equilibrium. 

Lemma 4.8 (LP Compactness). // an LP with n variables and rational coefficients, each repre- 
sented by at most j3 bits, is such that there is a point obeying each constraint to within e = 
then the LP is feasible. 

Proof. 

Lemma 4.9. If t, b, ti, bi, yi, Zi, (for 1 < i < n), are (3-bit integers, then either Yll=i TP^ > | or 

En Uni ^ t _ 1 
i=l biZi ^ h 2'-^"/^ ' 

Proof. Suppose we have Y17=i 5^ ^ I • Then the difference | —Y17=i least 1 / (fo-Hj bi Zi), 

which is at least 1/2'^+^"'^ < 2^'^"''^ since each integer in the product is at most 2'^. □ 

From Lemma 4.9, we get the following. If x satisfies Y17=i ^i^i ^ b — where each Oj and b 
are rational numbers whose numerators and denominators are representable as /3-bit integers, then 
X satisfies J27=i ^i^i — ^- This immediately implies the Lemma. □ 

Corollary 4.10. Given a linear program with < n variables and coefficients of the form | for 
integers a and b, each represented by at most /? bits, each coordinate of a vertex must be representable 
by 2 for integers c and d, each represented by less than 3n(3 bits. 

We use the next lemma to show that an approximate personalized equilibrium almost satisfies 
the constraints of Theorem 4.3. As long as e is small enough, this will imply by Lemma 4.8 
that an e-approximate personalized equilibrium will point us to a feasible LP that finds an exact 
personalized equilibrium. 

Lemma 4.11. An e\- approximate personalized equilibrium (with ei = 23|g|(/3+7) ) obey every 
constraint in program 4 to within e2 = \ for 7 bit integer d, if each utility value is representable as 
^ for integers a and b of at most j3 bits each. 

Proof. Assume for the sake of contradiction that we have an ei-approximate personalized equilib- 
rium that does not satisfy some constraint of the program to within £2- Let Wi{e) = the weight 
placed by player i on hyperedge e in this approximate equilibrium. The first three constraints of 
program 4 must be satisfied to within ei, since they are the definition of a feasible weight assign- 
ment. Therefore, assume this equilibrium does not satisfy the min constraint to within €2 for some 
player i and some subset F Q Ei for which LP 5 is feasible. 

Consider a solution 6* for LP 5 for this i and F. Let Ad = ^^rar^n, and let 6'(e) = 5*(e) -M. 

M is well-defined since 5*(e) < for all e £ F. Furthermore, for all e with 5(e) < (i.e., for all 
eeF), \S'ie)\<€2<Wi{e). 

Now consider the following slightly adjusted linear program. 

maximize 5{e)ui{e) 

eeEi 
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^5(e) =0 seSj,l<j <k,j^i (6) 



e:see 



5(e) > -€2 (e G F) 
(5(e) > (e ^ F) 

By our choice of S' and the analysis above, 6' obeys each constraint of the new hnear program 
6, and 6' gives a maximization value > 0. LP 6 has \Ei\ < \E\ variables, each coefficient Ui{e) 
can be represented as | for /3-bit integers a and b, and coefficient £2 = 3 for 7 bit integer d. 
The maximization point of an LP will be at a vertex, so by Corollary 4.10, each dimension of 
the maximization point of LP 6 will be representable by 5 for integers c and d, each of less than 
3\E\{l3 + j) bits. 

Let S = the solution to LP 6, and consider the alternate assignment for player i specified by 
w*{e) = Wi{e) + (5(e). By the first constraint of LP 6, this still does not overfill or underfill any 
strategy by more than ei, and player i still places total weight between 1 — ei and 1 + ei. By 
the second and third constraints, (5(e) < if and only if e G F, in which case |(5(e)| < 62 (when 
Wi{e) > €2), so w*{e) > 0. In other words, we still have a valid weight assignment for an ei- 
approximate personalized equilibrium. Since we know LP 6 has a solution > 0, and (from above) 
each coordinate of the solution is representable as ^ for integers c and d, each of at most 3\E\ (/3 + 7), 
this gives a total utility for player i that is more than ^3|g||^+^) = ei larger than the original total 
utility. Therefore, the original solution was not a valid ei-approximate personalized equilibrium, 
contradicting our assumption and completing the proof. □ 

Theorem 4.12. There is a polynomial time reduction from finding an exact personalized equi- 
librium in a game with \E\ edges to finding an e-approximate personalized equilibrium for any 
€ < |^|3|g|^9|g|2^^_3|g|g ; assuming all utilities can be represented as | for integers a and b, each of at 
most $ bits. 

Proof. The reduction consists of two steps. In the first step, we find an e-approximate personalized 
equilibrium for the given game in which we want to find an exact personalized equilibrium. In the 
second step, we solve the following linear program for Wi{e) and Pi{s), Vi G 1 .../>;, s G Sj, e G Ei. 
Let E'- c Ei = the set of all edges e such that player i assigned < 1/(|-K| • 2^1^!^) weight to edge e 
in the approximate equilibrium. 

^ Wi{e) < pj{s) 1 <i,j <k,s e Sj (7) 

^Pi(s) =1 l<i<k 
seSi 

Wi{e) =0 ye e E'i,l <i < k 

Wi{e) > l<i<k,eeEi\E'i 

^ — £;3|i!;|^29|^l^'3+3|f5|/3 ~ 23|-E;|log2 \E\+9\E\'^ l3+3\E\/3 ~ 23|B|(/3+3|B|/3+log2 |i5|) " SluCC 6 < 23|B|(/3+3|B|5+log2 |S|) ' 

by Lemma 4.11, the approximate equilibrium found in the first step will satisfy all constraints of 
program 4 to within ^31e\0+ios2 \e\ ~ 1/(1-^1 * 2^l'^l^). Therefore, a solution found in the second step 
will exactly satisfy all "min" constraints in program 4. Clearly, a solution found in the second step 
will exactly satisfy all other constraints in program 4, since the other constraints are identical. 



28 



Each value Wi(e) is being decreased by at most l/(|£'|2^l^l^) (but not to less than 0) from 
the approximate equilibrium to the solution to the second step, so the last two constraints in 
linear program 7 are satisfied exactly using the values from the approximate equilibrium, while the 
first two constraints in linear program 7 are satisfied to within 1/(2^1^1^) by the values from the 
approximate equilibrium. Therefore, the approximate equilibrium satisfies each constraint of linear 
program 7 to within e = 1/(2^1^1^). By Lemma 4.8, linear program 7 is feasible, so by Lemma 4.3, 
we can find an exact personalized equilibrium. □ 

Theorem 4.12 and Theorem 4.13 put Personalized Equilibrium in PPAD. 

Theorem 4.13. e- Approximate Personalized Equilibrium <p End of the Line 

Proof. We used fixed point theorems to prove the existence of a personalized equilibrium, and 
relaxing the problem to finding e-approximate equilibria automatically moves us from a continuous 
to a discrete world. Here, we show that finding an e-approximate equilibrium is in PPAD. This is 
not surprising given that several discrete fixed point problems have been shown to be in the class 
PPAD. Our proof uses the machinery already established for proving that finding approximate 
Nash equilibrium in r-player games is in PPAD [13]. Their proof [13] [Section 3.2] will apply to 
personalized equilibria as well, as long as we can define a polynomial-time computable function 
f{x) for X G M"'^ for a game with k players, n strategies per player, which satisfies the conditions 
we enumerate below. We need to introduce some notation first. For p G [k] and i G [n], we denote 
by Xp the {{p — l)n + i)-th coordinate of x (the amount that player p plays strategy i). For player 
p, let Dp denote the set {{p — l)n + j : j G [n]}; that is, the dimensions corresponding to the 
strategies of p. Then Xp is the projection of x on Dp and X-p is the projection of x on [nk] — Dp. 
The function f{x) must satisfy the following requirements for the proof to translate: 

1- Vp, Ei/(4) = i 

2. If \\x — x'lloo < S, then ||/(x) - /(x')lloo < C/ma.2P°iy <5, where m is the number of edges 
and Umax is the maximum payoff entry in the given instance. 

3. If ||/(x) — x||oo < ei, then x is an e-approximate personalized equilibrium. Here, we will use 
any ei < ^^x^max' proof from [13], ei only affects the number of nodes in the End of 
THE Line graph. 

We define /(.x) as follows: we set f{x)p to be the lexicographically least best response to .x_p. 
We now show that / satisfies the three conditions listed above. The first condition is immediate 
from the definition of f{x). For the second condition, fix x, x' , and a player p. Then f{x)p is 
obtained by solving a best response linear program for player p given the strategy distribution x_p 
of the other players. The LP, which we denote by O for this proof, is over the variables f{x)p, for 
strategy i G Sp, and Wp(e) for every edge e, and maximizes a linear utility u{f{x)p, Wp) subject to 
linear constraints B ■ {f{x)p, Wp)'^ > c. We note that every element of B is either or 1 and every 
element of c is either 0, 1, or a coordinate of x_p. Similarly, f{x')p is an optimal solution to an LP 
O', which maximizes u{f{x')p,Wp) subject to B ■ {f{x)p,Wp)^ > c', where c' is derived from x'_p in 
the same way as c is derived from x-p. 

Let U and U' denote the optimal values of O and O'. We first argue that if — x'||oo < S, then 
\U — U'\ < mUuiaxi'iT'ky.S , where m is the number of edges and f7max is the maximum payoff entry 
in the given game. We note that x satisfies the constraints of O' to within 6. We also know that O' 
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is feasible. The number of variables and constraints in both O and O' arc n + m and nk + m + 1. 
Therefore, by Lemma 4.14, there exists a point y that satisfies the constraints of O'^ such that 
||y 3;||oo < {nk)\8; here we use the fact that every entry in the constraint matrix and vector of O 
and O' is at most 1. Thus, the utility achieved by y is at least u{f{x)p, Wp) — mUinax{nk)l5 , yielding 
U' > U — mUi^s.^{nk)\5 . Similarly, we have U >U' — mUmaxinky.S . This gives the desired bound 
\U-U'\ < mUmi,^{nk)\5. 

By definition, we have that {f{x)p, Wp) is the lexicographically least element of the feasibility 
LP consisting of the constraints of Op together with the constraint u{f{x)p,Wp) > U. Let us call 
this LP V. Similarly, (f(x')p,Wp) is the lexicographically least element of the feasibility LP T" 
consisting of the constraints of O' together with the constraint u{f(x')p,Wp) > U' . We note that 
P and P' have the same set of variables and the same constraint matrix; that is, P and P' can be 
written down as Ax > b and Ax > b' respectively. Since ||a;— a;'||oo < ^ and \U — U'\ < mUmaxinky.S , 
we have \\b — b'\\oo < 'mUraa,x{nk)\S . We now apply Corollary 4.15 to obtain that \\f{x)p — /(a;')p||oo 
is at most ?7max2P°'y("'"''^)(5. 

For the third condition, recall our definition of an e-approximate personalized equilibrium. We 
require: (3a) for every player p, 1 — e < J2e "^'pi^) ^ (3b) for each player pair p and g, and for each 
strategy s, |X^e-see ^''^p('^) ^ Se-see ^'?('^) I — ^' ^^'^ (3*^) best response weight assignment w* 

for any player p, w*{e)up{e) — ujp{e)up{e) < e. (3a) is immediate, and we have Yle '^eip) = 1- 
For (3b), recall that yp is the exact best response to X-p. Therefore, for any player pair p and g 
and strategy s of g, we could find a weight assignments w on all edges e (specifically, the weight 
assignments that made this a best response) such that X^e-s'ee '"^p(^) ~ Vp (^'^^ strategies of 

p), and ^e-sge ""^pC^) ~ ^q- Since w was a weight function for y, we also have Yle-see'^qi^) ~ Vq- 
We are told that — is at most €i, so we have | X^e-see '"^p(^) ~ X^e-see — ^i- 

Condition (3c): As above, we can define the weight function Wp{e) that makes yp a best re- 
sponse against x-p. Also define any weight assignment Wp that gives (for all strategies s of p) 
Xe-see^p(^) ~ ^p- -^o^ strategy s of p, we are told that \yp — Xp\ < ei, so we can say for 
any strategy s of p, Ee:see^^p(e) - Ee:see^p(e) < ei ^ Ee:see "'p(e)^ip(e) - Ee:see «^p(e)«p(e) < 
eit/max- This means E J Ee:see ^p(^)"p(«^) ~ Ee:see ^p(^)^p(^)I < ^eif^max if n is the number 
of strategies for p. We can remove the absolute values because w* was a best response, giving 



Lemma 4.14. Given a q x r matrix A, an q-vector b such that Ax > b is feasible, and p & W 
and e G such that Ap > b — e, there exists p' satisfying Ap' > b such that \\p — p'\\oo is at 
most eraaxi.-^maxDmax)'^ ! where Cmax — max^ e^, A-fnax equals maxjj \ A,ij\ and Dmax is the largest 
determinant, in absolute value, of any submatrix of the matrix consisting of the columns of A and 



Proof. We find a point y such that Ay > b — Ap and ||y||oo < emax(^max-Dmax)^- Setting p' = p + y 
gives us the desired lemma. We first note that Ay > b — Ap is feasible since it is satisfied by the 
point X — p, where x satisfies Ax > b. Let d equal b — Ap. So our goal is to find a y satisfying 
Ay > d. By our assumption on p, we have di < emax for all i. 

Consider the following algorithm for constructing y. Set y = and L to be the empty LP. At 
the end of i iterations, we will maintain the invariant that ||y||oo ^ (-^mEix-^max)*6max- 

Find any 

constraint Aky > dk not in L that is not satisfied. (If no such constraint exists, then we are done.) 
Add this constraint to L. By the invariant on it follows that \A)^y\ is at most ^^aL-^max^max- 



Ee '^p{^)'^p{^) ~ Ee '^p{^)'^p{^) < e as required, as long as e; < e 




□ 



6. 
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Since < Cmax) it follows that \dk\ is at most ^J^ax-^max^max- Since the right hand side of every 
inequality of L is at most this number, and the left hand side is a submatrix of A, by Cramer's rule 
there exists a vertex of L, every coordinate of which has magnitude at most ^Ji^aL-^max^max times 
the largest entry in the determinant of any submatrix of A, which is at most £>max- (Note that L is 
feasible since Ay ^ d is feasible.) This yields the desired invariant ||y||oo — (^max-^max) ^max* 

The above procedure stops in at most q iterations, and yields a point y such that ||y||oo ^ 
emaxC^max^max)'', thus Completing the proof of the lemma. □ 

Corollary 4.15. Let A be an qxr matrix, b be an q-vector, and p be the lexicographically smallest 
vector in Ax > b. Let b' G M'^ be such that Ax > b' is feasible. Lf p' is the lexicographically smallest 
vector in Ax > h' , then \\p — p'\\oo is at most emax{AmaxDmaxy'^'^'^^'^'^^\ where emax = maxj \bj - b'j\, 
■^max = maxjj \Aij\, and Dmax is the largest determinant, in absolute value, of any submatrix of 
the matrix consisting of columns from A and b. 

Proof. Let L denote the LP Ax > b' . We apply Lemma 4.14 with {A,p, b, e) replaced by {A,p, b' , 6— 
b') to obtain a point p' satisfying L such that \pi — p'i\ is at most emax(^max^max)''- We add a 
constraint xi = p[ to the LP L and apply Lemma 4.14 with {A,p,b,e) replaced by {A,p,b,e), 
where A is the constraint matrix of L, b is the right-hand side of L, and e is the vector obtained 
by adding two additional coordinates to e, each with magnitude at most \pi — Pi\ (for the two new 
inequality constraints resulting from the addition of xi = qi). We obtain a new point p' satisfying 
L such that \pi — p'i\ and \p2 — ^2! both at most emax(^max-Cmax)^'^'''^- Repeating this for all 
the coordinates yields the lexicographically smallest vector p' of Ax > b' with ||p — p'||oo at most 

Cmax(-'4-max-^max)^ ^ "'^ ^. CH 

5 Scairf 's Lemma and Fractional Stability Problems 

This section discusses the complexity of a number of well-known combinatorial problems that 
can be categorized as fractional stability problems. We begin with Scarf's Lemma, a fundamental 
result in combinatorics, originally introduced to prove that every balanced cooperative game with 
non-transferable utilities has a nonempty core (see Section 5.3) [41]. The core (no pun intended) 
of Scarf's proof is an elegant and constructive combinatorial argument, which has been applied to 
diverse combinatorial problems, including fractional stable matchings in hypergraphic preference 
systems, strong kernels in digraphs, and the fractional stable paths problem [2, 1, 28, 21]. Wc 
first show that the computational version of Scarf's lemma is PPAD-coniplete. We then establish 
the PPAD-completeness of stable matchings in hypergraphic preference systems, strong kernels in 
digraphs, core of balanced games with non-transferable utility, the fractional stable paths problem, 
and a fractional version of the Bounded Budget Connection game [30, 31]. 

5.1 Scarf's Lemma 

In the computational version of Scarf's lemma (Scarf) we are given matrices B, C and a vector 
b satisfying the conditions in Theorem 5.1, and the goal is to find a € W\. satisfying the desired 
properties. 

Theorem 5.1. (Scarf's lemma Let I = [5ij\ be an m x m identity matrix. Let [n] = 

{1,2, . . . ,n} . Let m < n and let B be an m x n real matrix such that bij = 6ij for 1 ^ i,j ^ m. 
Let b be a non-negative vector in W^, such that the set {a G M" : Ba = b} is bounded. Let C be 
an m X n matrix such that cu ^ oik ^ Cij whenever i, j ^ m, i ^ j and k > m. Then there exists a 
subset J C [n] of size m such that 
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(PI) Ba = bfor some a G such that ctj — whenever j ^ J, and 

(P2) For every k G [n] there exists i G [m] such that ^ Cjj /or a// j G J. 

A subset J C [n] of size m is called a feasible basis of (Z?, 6) if it satisfies (PI) , and subordinating 
if it satisfies (P2). To compute a of Scarf, it suffices to have a J C [n] that is simultaneously 
subordinating and a feasible basis. Once such J is computed, a can be computed by solving a 
system of linear equations. Also, given a solution a, J is easy to compute, since J is a's support. 
Hence finding a and J are computationally equivalent, to within polynomial time. In Theorem 
5.2, we argue that Scarf's original proof [41], together with Todd's orientation technique [46], gives 
an end of the line argument for the existence of a subordinating and feasible basis, thus showing 
that Scarf is in PPAD. 



Scarf: Given matrices B and C and vector b G M™, all obeying the requirements from Theorem 
5.1, find a subset of m column indices that is a feasible basis for {B, b) and is subordinating for 
C. 



Theorem 5.2. Scarf <p End of the Line. 

Proof. The pair (5, b) is non-degenerate if b is not in the cone spanned by fewer than m columns 
of B. We call C ordinal- generic if all the elements in each row of C are distinct. There exists a 
small perturbation b' of b such that the pair (i?, 6) is non-degenerate and every feasible basis for 
(B, b') is also a feasible basis for [B, b). By slightly perturbing C, we can obtain an ordinal-generic 
matrix C' satisfying the assumptions of the theorem, and if the perturbation is small enough, then 
any subordinating set for C is also subordinating for C. Hence, we may assume that (5, b) is 
non-degenerate, and that C is ordinal- generic. 

Lemma 5.3 is well-known. Its proof requires that {a G : Ba = b} is bounded and {B, b) 
is non-degenerate. For the proof of Lemma 5.4, we refer the reader to [41] or [2] or page 1127 of 
Schrijver's Combinatorial Optimization book [42]. Proof of Lemma 5.4 uses the assumption that 
C is ordinal-generic. 

Lemma 5.3. Let J be a feasible basis for (B, b), and fc G [n] \ J. Then there exists a unique j G J 
such that J + k — j {i.e., J U {k}\{j}) is a feasible basis. Also, given J and k, we can find j in 
polynomial time. 

Lemma 5.4. (Scarf [41]) Let K be a subordinating set for C of size m-1. Then there are precisely 

two elements j G [ji-JV^ such that K + j is subordinating for C, unless K C [m], in which case 
there exists precisely one such j. Given K, we can find values of j in polynomial time. 

The natural pivot rules arising from Lemma 5.3 and Lemma 5.4 are called the feasible pivot 
rule and the ordinal pivot rule respectively. 

The original proof of Scarf's lemma ([41], [2]) uses an "undirected end of the line argument", 
thus showing its PPA-membership. It is easy to see that PPAD C PPA, however it is unknown 
if PPAD = PPA. To prove PPAD-membership of SCARF, we need a ^^directed end of the line 
argument" . Shapley [44] presented a geometric orientation rule for the equilibrium points of (non- 
degenerate) bimatrix games based on the Lemke-Howson algorithm [32]. Extending Shapley's rule, 
Todd [46] developed a similar orientation theory for generalized complementary pivot algorithms. 
We now apply Todd's orientation technique to prove PPAD-membership of SCARF. 
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Let X = {1,2, . . . ,n}. A subset of X of cardinality m is called an m-subset. Let X„t denote 
the collection of ordered (with the natural ordering defined by X) m-tuples of distinct elements 
of X. Two m-tuples in X^ are equivalent iff one is an even permutation of the other. Let P be 
any element of an equivalent set. We denote the corresponding equivalent set by P. If P' G Xm 
is an odd permutation of P G Xm, then we call P' the negative of P and write P' = —P. Let 
P = (ei, . . . , e„) G Xn- For = ±1, we say P contains /u(P\ei) positively (negatively) if /x(— 1)' is 
positive (negative). 

Let e G X be a specific element. Let !F be the set of all feasible bases containing e, and S be 

the set of all subordinating sets of size m not containing e. Note that both JT and S are m-subsets 
of [n]. Let V{J-,S,e) be the set of pairs {F,S) E J- x S satisfying cither (i) F = ±5 (called a 
matched pair) or (ii) e £ F,e ^ S and F\S = {e} (called an unmatched pair). A matched pair 
(r, T) is positive, while (T, — T) is negative. An unmatched pair (P, S) is positive (negative) if F 
is contained in {S U e) positively (negatively). 

Lemma 5.5. (Todd [46]) (a) Every matched pair is adjacent to one unmatched pair by a feasible 
pivot, or one unmatched pair by a ordinal pivot, but not both, (b) Every unmatched pair is adjacent 
to one pair by a feasible pivot and one pair by a ordinal pivot. 

Lemma 5.6. (Todd [46]) (a) If two unmatched pairs are adjacent by a feasible pivot, they have 
opposite signs, (b) If a matched pair and an unmatched pair are adjacent by a feasible pivot, they 
have the same sign, (c) If two pairs are adjacent by a ordinal pivot, they have opposite signs. 

Similar to [46], we construct a directed graph with vertices representing the pairs in V{T, S, e). 
If two unmatched pairs are adjacent by a feasible pivot, we add a directed edge from the negative 
pair to the positive pair. If a matched pair is adjacent by a feasible pivot to an unmatched pair, 
we add a directed edge from the matched pair to the unmatched pair if both are positive and in 
the reverse direction if both are negative. If two pairs are adjacent by an ordinal pivot, we add 
a directed edge from the positive pair to the negative pair. Prom Lemmas 5.5 and 5.6, it follows 
that each unmatched pair has indegree 1 and outdegree 1. Each matched pair has in degree and 
outdegree 1 if positive, and indegree 1 and outdegree if negative. It is easy to see that [m] is in 
and is not subordinating. By Lemma 5.4 there exists f ^ e such that [m] — e + / is in S. We shall 
use the pair ( [m] , [m] — e + /) as the initial source of End of the Line. This gives the required 
PPAD property. □ 

In Section 5.2, we establish the PPAD-hardness of Fractional Hypergraph Matching, 
which reduces to SCARF in polynomial time [1], thus completing the proof that SCARF is PPAD- 

complete. 

5.2 Hypergraphic Preference Systems 

A hypergraphic preference system is a pair (H,0), where H = (y,E) is a hypergraph, and 
O = {-^y : V G V} is a family of linear orders, being an order on the set of edges containing the 
vertex v. A set M of edges is called a stable matching with respect to the preference system if (a) 
it is a matching and (b) for every edge e there exists a vertex v G e and an edge m £ M containing 
V such that e m. A nonnegative function w on the edges in H is called a fractional matching if 
X^i;e/i ^{f^) ^ 1 foi' every vertex v. A fractional matching w is called stable if every edge e contains 
a vertex v such that E,;eft,e^„fe ^(^) = 1- 

Aharoni and Fleiner [1] used Scarf's lemma to prove that every hypergraphic preference system 
has a fractional stable matching. This naturally leads to a computational problem - Fractional 
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Hyper GRAPH Matching : given a hypergraphic preference system {H, O), find a fractional stable 
matching. 



Fragtional Hypergraph Matching: Given a hypergraph H and a preference ordering O 
for each node in H, find a weight assignment across the edges such that the weight adjacent 
to each vertex is at most 1 and each edge e includes some vertex v that is adjacent to weight 
exactly 1 on edges preferred by v at least as much as e. 



We first observe that the proof of [1] is a polynomial time reduction from FRACTIONAL HY- 
PERGRAPH Matching to Scarf, thus placing it in PPAD. We now show that Fractional 
Hypergraph Matching is PPAD-hard via a reduction from preference games. 

Theorem 5.7. Degree d Preference Game <p Fractional Hypergraph Matching. 

Proof. We are given a preference game over players [n] = {1, . . . ,n}. We construct the following 
hypergraph matching instance {H, O), H = {V, E). The set V of vertices is [n] U {i* : i £ [n]}; that 
is, we have two vertices i and i* for each player i. The set of edges is given by the following. 

{{i*} : i G [n]} U{{i, U Ji : i G [n], J, C in(i)}} 

(Note that Jj is a subset of players that prefer i over themselves.) 

We next describe the linear order for a given vertex i. Let ei and 62 be two edges containing 
i. By our construction of E, there exists a unique ii such that is a subset of e\. Similarly, 

there is a unique 12 such that {^2,^2} ^ subset of 62. If ii 7^ ^2, then we require that ei >zi 62 if 
and only if ii 12. If ii = 12, then we require the following condition on ei 62 whenever 
ei D 62. Finally, for any vertex i*, we select any linear order in which 61 >zi* 62 whenever is 
a subset of 61 and e ^i* {i*} for all e. 

The number of vertices in the above hypergraph is 2n, and the number of edges is at most 
n(2'^ + l), where d is the maximum in-degree of the preference game. Since we are given a preference 
game of constant degree, the above construction is polynomial time. 

We show that there is a stable solution for the preference game if and only if there is a stable 
fractional matching for the hypergraph preference system. Suppose u; is a stable solution for the 
preference game: Wij represents the weight assigned by player i to player j. For a given player j, we 
sort all the players i in in(j) in nonincreasing order of the wij values; let the order be ji, j2, • • • , Jdj, 
where dj is the in-degree of j. To every edge of the form {j, j*} U {ji, . . . , j^}, 1 < A; < dj, we assign 
the weight Wj^j — Wj^j^^j. We assign weight Wj^, to the edge {3,3*} U in(_7) and weight Wjj — Wj-^j 
to the edge {i, j*}- Finally, we assign weight 1 — Wjj to the edge {j*}- This ensures the following: 

Ee:0j*}6e /(e) = Wjj for all j 
Ee:{j,j*,j}ee /(e) = Wij for all j, i G in(j) 
We next argue that the fractional matching / thus defined is stable. 

There are three types of edges for us to consider. (1) e = {j, j* , ji, j2, ■ ■ ■ ,jk} for some j,k, (2) 
e = {3,3*} U S for some j, S / {ji, j2, • • -Jk} for any k, and (3) e = {j*} for some j 

First consider e = {j,j*,ji,j2, ■ ■ ■ ,jk} for some j. A;. We separate this into two cases. The first 
case is when there is no proper subset of e that has positive weight. In this case, we argue that j is 
a vertex in e such that E^^^-e /(^) equals 1. Eft^^e /(^) = ^itjj ^h:{i,i*,j}eh + EeCh /(^) = 
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J2iyjj'^ji + J2h:eChfih) + J2h:hCefih) = J2iyjjWji + J2h:{j,j*}hfih) = Y^i-^.jWji + Wjj = 1. 

The second case is when there is some proper subset e' of e with positive weight. Say e' = 
J2j • • • -.js-i} for s < k. Because s < k, jg G e. We will show that jg is a vertex in e such 
that Ylih'^j e /(^) equals 1. Since e' has positive weight, Wj^_-^j — wj^j > ^ Wj^j < wjj. Therefore, 
since w was a preference game equilibrium, ^iy.jWj^i = 1. So, ^iy^j'^h-.li^* ,js}eh 

m = 1 ^ 

T,h:{j,j*,js}eh + T.iyjJ,i9^j T,h:{i,i*,j,}€h /(^) = ^ ^ ^^^/i^.-.e /(^) = l" 

Next consider e = {j, j*} U S for some j, S ^ {ji,j2, ■ ■ ■ ,jk} for a-ny /c. Now, pick edge e' D e, 
e' = {ji, j2, • • • ,jk} for Jfc £ e. Again, we can separate this into two cases based on whether or 
not there is a proper subset of e' with positive weight. If there is no such proper subset, then j 
will have J2hyje fi^) ~ same argument as above. If there is a proper subset e" C e' 

with positive weight, we will argue that jk satisfies Ylhy e/(^) — ^- Since {j,j*} G e", jk 4- 
j:h={j,r}osfih) > f{e") + T.h:{j,rMehfih) > fi^") + ^i.r We picked e" such that 

/(e") > 0, so Wjj > Wji^j. As in the previous paragraph, this implies that "^i^y . g /(^) ~ 1- 

— 

To complete this direction of the lemma, consider an edge {j*} for some j. By our construction, 
this is the least preferred edge for j*, and the assignment of weight 1 — Wjj guarantees that the 
sum of the weights of all edges containing j* equals 1. 

We next prove the other direction of the lemma. Suppose / is a stable fractional matching for 
the hypergraph preference system. We construct the following assignment for the preference game. 
We set Wij to be the sum of the weights of edges containing the subset It is easy to see 

that Wij < Wjj for all i and j. It remains to argue the stability of w. 

We first claim that if / is stable, then for any Si and ^2 such that Si — S2 and ^2 — Si arc both 
nonempty, at most one of f{{j,j*} U Si) and f{{j,j*} U ^2) is positive. To see this, observe that 
if both are positive, then for every vertex v in the edge e = {j,j*} U SiU S2, the sum of weights 
assigned to edges that arc at least as much preferred by v as e is less than one since v is in either 
{jj J*} U 5*1 or {j,j*} U 5*2, both of which have positive weight and arc less preferred than e by v. 
This implies that such a matching could not be stable for edge e. Thus, in /, the positive weights 
to edges containing {j,j*} are all assigned to a chain of edges ei C 62 . . . C e^, for some k. Define 
efe+i to be {j,j*} U in(j). We next observe that for every vertex v m Si — ej_i, 1 < z < A; + 1, the 
sum of the weights of the edges v prefers at least as much as ej equals 1. This is because such a 
vertex exists in Cj-i U {v} (by the definition of stable matching) and v is the only possibility. 

Consider any Wi£ > 0. To establish stability of w, we prove by a contradiction that for all j 
such that j i, Wij = Wjj. Suppose not, then there exists a j such that j i, and two edges 
6) '5' 5 {j,j*} with i £ e, i ^ e' , and f{e') > 0. Let e denote the smallest edge containing i in 
the chain ei C 62 . . . C Ck+i mentioned in the preceding paragraph. (Since i G e^+i, e exists.) By 
the argument above, the sum of the weights of the edges i prefers at least as much as e equals 
1. However, wa > implies that there exists an edge e" D {£,£*,%} with /(e") > 0, yielding a 
contradiction since i prefers e over e". □ 

5.3 Cooperative Games with Non- Transferable Utilities 

Definition 5.8. A game with non-transferable utilities over n players is specified by a function V 

that for each subset S of N = {1,2, ... ,n} returns a set V{S) of outcomes - each outcom,e being a 
vector of utility values, one component for each player in S. A collection T of coalitions is balanced 
if there exists an assignment of reals 5s for each coalition S inT such that for all v, Yls-v&s = 
We say that u is attainable by S if u £ ^i^)- ^ game is balanced if and only if for any balanced 
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collection T and any u, if us is attainable by all S in T, then u is attainable by N. 

As mentioned earlier, Scarf [41] proved that every balanced game has a nonempty core. We 

define Core-Balanced-NTU below, a natural computational version of this claim. Scarf's 
proof [41], which is a reduction to Scarf, together with Theorem 5.9 establish its PPAD- 
completeness. 



Core-Balanced-NTU: The game is specified by a set N of players, a collection S of proper 
subsets of (the coalitions), and for each S £ S, vectors ui, . . . , u^g in R''^' such that V{S) = 
{u G MI-^I : 3j u < Uj}. For a coalition 5^5, V{S) = {O}!-^! and V{N) is defined as the set 
of all u for which there exists a balanced collection T such that us is attainable by all S in T. 
The goal is to find an element in the core. 



Theorem 5.9. Fractional Hypergraph Matching <p Core-Balanced-NTU. 

Proof. Suppose we are given a hypergraph H and for each vertex i, a preference ranking among all 
edges containing i. We first add, for each vertex i in i7, a new vertex i* and edge {i, i*}. We set the 
preference of i for the edge {i,i*} to be the least among all the edges containing i. Let N denote 
the new set of nodes and E the new set of edges. For S e E and i e N, let ri{S) denote the rank of 
S in i's preference list, with assigned to the least preferred edge (thus for every i, rj({i, i*}) = 0). 
We now define a balanced cooperative game with non-transferable utilities. For each node in N, 
we have a player in the game. For any coalition S, we consider two cases, li S E E, then we have a 
single vector rs = {rij^{S),rir^{S), . . . ,ri^g^{S), where S = {ii,i2, ■ ■ ■ ,i\s\)- Note that by definition, 
a S ^ E and S ^ N, then V{S) equals QI^L 

For N, note that V{N) is precisely the set of all u such that us is attainable by all S in some 
balanced collection T. We first observe that we can determine in polynomial time whether a given 
u is in V{N). For each S, if u < rs, then we have a variable xs for S. Now we simply solve the 
linear program: 

1^ 2:5 = 1 

S:ieS 

It is easy to see that the linear program is feasible if and only if u is in V{N). Consider any 
balanced collection T; if we have a u such that us is attainable by all coalitions S in T, then the 
above linear program would be feasible - the 6s values that verify the balanced condition yield the 
solution for the above LP, and hence u is attainable by N. For the other direction, consider any 
u that is attainable by N. Then, by our construction the above linear program is feasible. The 
Xs values we obtain precisely specify the Ss values, meaning that us is attainable by every S for 
which ^5 > 0. 

It is straightforward to compute the above reduction in time polynomial in H. We finally 
claim that from an element of the core, a fractional stable hypergraph matching can be obtained in 
polynomial time. Suppose u is in the core. Since u is attainable by N, we find the xs that satisfy the 
above linear program. We claim that the weights xs yield a stable fractional hypergraph matching 
in H. Consider any edge S'. Since u is in the core, there exists a player i in S' such that the utility 
for z in u is at least as high as that for i in V{S'). Since u is attained by N, the utility (preference) 
of i in each S for which X5 > is also at least as high as that of i in S'. Thus, xs yields a stable 
matching. □ 
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5.4 Fractional Stable Paths Problem 

The Fractional Stable Paths problem, introduced in [21], is defined as follows. Let G be a graph 
with a distinguished destination node d. Each node v ^ d has a list tt{v) of simple paths from v 
to d and a preference relation among the paths in Tr{v). For a path S, we also define ^{v, S) 
to be the set of paths in Tr{v) that have 5 as a suffix. A proper suffix 5 of P is a suffix of P such 
that 5 7^ P and 5 7^ 0. 

A feasible fractional paths solution is a set w = {w^ : v ^ d} oi assignments Wy : 'it{v) — > [0, 1] 
satisfying: 

1. Unity condition: for each node v, X]pg7r(i;) '^v{P) < 1 

2. Tree condition: for each node v, and each path S with start node u, J2pen{v S)''^'"i-^) — 

Wu{S). 

In other words, a feasible solution is one in which each node chooses at most 1 unit of flow to d 

such that no sufRx is filled by more than the amount of flow placed on that suffix by its starting 
node. A feasible solution w is stable if for any node v and path Q starting at v, one of the following 
holds: 

(51) X^pg7r('u) ''^v{P) = 1) and for each P in Tr{v) with Wv{P) > 0, P >v Q\ or 

(52) There exists a proper suffix 5 of Q such that X]pg7r(i,- s) ^-"viP) = "WuiS), where u is the start 
node of S, and for each P G 7r{v, S) with Wv{P) > 0, P >^ Q. 

In other words, in a stable solution: if node v has not fully chosen paths that it prefers at least as 
much as Q, then it has completely filled path Q by filling some suffix with paths it prefers at least 
as much as Q. 

We define a computational version. Fractional SPP. 



Fractional SPP: Given a graph, a destination node, and a preference list for each node 
across paths to the destination. Find a weight assignment for each node to the paths in its 
preference list that is both feasible (satisfies the Unity and Tree conditions) and is stable (every 
path satisfies property (SI) or (S2)). 



We note that Haxell and Wilfong [22] show Fractional Hypergraph Matching <p Frac- 
tional SPP (see Section 5.2), and the problem of finding a fractional co-acyclic kernel (related to 
Strong Kernel, sec Section 5.5) can also be reduced to Fractional SPP. Together with our 
reduction from FRACTIONAL SPP to Personalized Equilibrium (see Theorem 5.11 below), this 
gives an alternate proof of PPAD-membership for these two problems. 

5.4.1 PPAD-completeness 

Theorem 5.10. Preference Game <p Fractional SPP. 

Proof. We are given a preference game over player set [n], including preference relation for all 
i G 1 . . . n. We will convert this into a fractional stable paths problem. Create a node Vi for each 
i. Also create a universal destination node d. For all i, define Pa = the path {vi,d). For all i,j, 
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define Pij = the path {vi,Vj,d). Let 7r(wi) (the set of preferred paths for Vi) = {Pij : j >zi i}. If 

khi j, then Pik hi Pij- 

Let Wi{j) refer to the amount of weight placed by node Vi on path Pij in a fractional SPP 
solution, and let Wi{i) be the amount of weight placed by i on path Pa. Now we will show that w 
is a fractional stable paths solution if and only if w defines an equilibrium of the preference game. 
It; is a fractional stable paths solution ^ t;; is an equilibrium of the preference game.. 
By the unity condition, for each i, X]j.p.^.g^(^^) Wi{j) < 1 ^ J2j '^i{j) ^ 1- starts at fj, and there 
is no proper final sufBx of Pa, so condition (SI) must apply for Pa. Therefore, X]j.p.^.g-^(^.) Wi{j) = 

^i(j) = 1, as required for the preference game. By the tree condition, for any Spg7r(r) p^^ 
weight on P < Wj{j) Wi{j) < Wj{j). So u; is a feasible weight assignment for the preference 
game. 

Now suppose for contradiction that w is not lexicographically maximal (with respect to w-i) 
for player i in the preference game. Then, there is some feasible weight assignment w' and some j 
such that Ylk^ij ^«(^) < "^k^ij ^i(^)- Take the lexicographically maximal such w' and the highest 
preference such j (from i's preference list). By this choice of w' and j, J2k)~ij "^ii^) = Ylky^j ^i(^)' 
so ^k=.jWi{k) < it^^(fe)- There must be some j' with j' =j j such that Wi{j') < w[{j'). 

Consider path Piji. (S2) is not true by our choice of j' and the fact that w' was a feasible solution 
(so w[{j') < Wj'{j')). However, since X]A;=,j' ^*(^) < SA:=i/^K^)' there must be some path Pj^ 
such that k -<i f with Wi{k) > 0. So (SI) is also not true, and w was not a stable solution - a 
contradiction. 

w is an equilibrium of the preference game ^ u) is a fractional stable paths solution.. 

We know that J2j ^i(i) = 1 for all i. This immediately satisfies the unity condition. Since w is 
a feasible set of weights for the preference game, Wi{j) < Wj{j) for all This means that the 
weight placed on Pij is at most the weight placed on Pjj. Since Pij is the only path from Vi that 
passes through node Vj, the tree condition holds. Now consider any path P^ from node i. Case 
1: Wi{j) = Wj{j). In this case, condition (S2) is satisfied. Case 2: Wi{j) < Wj{j). Because w 
was lexicographically maximal, any weight assignment w' with Ylk^a'^ii^) — Ylk^ij ''^ii^) must 
be infeasible. We said that Wi{j) < Wj{j), so it is only possible for all such w' to be infeasible if 
"^k^ij '^i{k) = 1- Then X^fe^jj ^i(^) = 0, so (SI) is satisfied. □ 

Theorem 5.11. Fractional SPP <p Personalized Equilibrium. 

Proof. Suppose we arc given an instance of FRACTIONAL SPP, consisting of a set of nodes V, a 
set of preferred paths tt{v) for all v & V, and a preference relation hv for each set tt(v). We can 
also find 7r(f , S), the set of all P G Tr{v) such that 5" is a subpath of P. Let qv{P) = the number of 
paths Q such that P >Zv Q. 

We will create the following instance of PERSONALIZED EQUILIBRIUM. The set of players is V. 
The set of strategies for a node V is it{v) U {N} (N stands for "No path"). For node v, there is 
exactly one edge defined for each strategy. Edge P' for strategy P = {5 : P G 7r{v,S)}. The edge 
for strategy N {N') is a singleton edge, containing only that strategy. The payoffs to player v are: 

Uv{P') = qv{P) + 1, u^{N) = 1. 

Suppose w is a set of weights in a personalized equilibrium of the game defined above. Wv{P') 
represents the weight assigned by v to edge P'. We will show that w is a personalized equilibrium if 
and only if w' : w[,{P) = Wy{P') is a fractionally stable solution to the Fractional SPP instance. 

First, assume ti; is a personalized equilibrium. Then, we know that for all w, the total weight 
placed by v on all edges is 1, or Wv{N) + ^p^T^[^v)Wy{P') = 1. Therefore, ^p^T^{y)Wv{P') < 
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1 =^ Z]pe,r('y) '^'vi^) < 1) SO the Unity condition holds. Also, the sum of weights placed by v on 
edges adjacent to a strategy S of another player v' is at most Wy'{S). That is, for path S G Tr{v') 

so the Tree condition holds. Finally, take any path Q G 7t{v). Case 1: The payoff to v in the 
personalized equilibrium is at least qv{Q) + 1. In this case, we know that v puts a total of weight 
1 on edges with payoff at least q^{Q) + 1, or Ep':«,(p')>g.(Q)+i ^^(^') = ^ ^ Ep:Pb.Q ^^(^') = 
1 =^ ^p-py^QWy{P) = 1, so condition (SI) holds. Case 2: The payoff to v in the personalized 
equilibrium is less than qv{Q) + 1- Since this is a personalized equilibrium, it cannot be possible 
for V to move some weight off a lower paying hyperedge onto a higher paying hyperedge. This 
includes moving weight from any of the edges in the equilibrium with payoff less than qv{Q) + 1 to 
the edge Q' . By nature of the edges we've defined, if P' H Q' for P', Q' G vr(f ), then either P' C Q' 
or Q' c P' . This means that there is some S G Q'{S G 7r(t;') such that YIr'-s&R' Wv{R') = Wyi{S') 
and for all R' : S e R', if Wy{R') > then qy{R) > qv{Q). So, J2R&n(v,S)'^v{R') = Wy>{S') =^ 
J2r£tt(v s)''^vi^) — ''^v'i'^)^ ^'^^ ^ ^ T^{v,S) with w[,{R) > 0, R Q, as required for 
condition (S2). 

Next, assume w' is a fractionally stable solution. We can assign weights Wy{P') = w'y{P), 
Wv{N) = 1 — I^pg^(,„) ii'i;(-P). The Unity condition ensures that J2p£n{v)''^'v{P) ^ ^^{N) > 
and we have a set of weights that sum to 1 for any player v. The Tree condition says that 
^P&TT{v,S)'^viP) ^ w'^'i^) any S G 7r{v'), which gives ^p',s^p' Wv{P') < w^i^S'), as required 
for a feasible solution. Finally, we must verify that Wy is a best response for player v. Let w* 
be the best response weight function for v, and for the sake of contradiction, assume w* gives a 
better total payoff. Look at the edge P' with the highest qv{P) such that w*{P') > Wy{P'). By 
nature of the edges we've defined, if P' Pi Q' for P',Q' G vr(i'), then either P' C Q' or Q' C P'. 
Therefore, for all edges P" with q^^P") > qy{P'), if w*{P") < Wy{P"), then we could increase 
w*{P") and improve the payoff, so P' is the highest utility edge in which and w* differ. Now 
look at edge P' with weights w in the fractional stable paths problem. Since w*[P') > Wv{P') and 
wl{P") = w.ij{P") for all P" with higher payoff than P', then for all S* G P' (s G 7r{v') for some 

v'),ER':SeR'MR)>qv{P)^^(^') < ^viS') => T.Ren{v,S)MR)>iv{P)^'^^^^ < K'i^)' so condition 
(S2) is not satisfied. However, since v puts less weight on edges with payoff at least as high as 

the payoff for P', the total payoff to is < qv{P) + 1. Therefore, J2R'-q^{R)>qy{p)'^v{R') < 1, so 

"^Ry P ^ 1' so condition (SI) is also not satisfied. This means that w' was not a fractionally 

stable solution, contradicting our assumption. So w must have been a best response weighting for 

each V. □ 

5.4.2 Special Cases of Fractional SPP 

Theorem 5.12. Fractional SPP is PPAD-hard even if each node's preference list consists of all 
paths, ordered shortest to longest based on edge length (where each node defines its own edge lengths, 
which may not obey triangle inequality). 

Proof. In the reduction from preference games to fractional SPP in Theorem 5.10, each path in 
any preference list has either 1 hop (a direct path to the destination d) or two hops. For each of 
these two hop paths (i ^ j ^ d), let Qij = the number of paths P such that P >i {i ^ j ^ d). 
Notice that {i ^ j ^ d) >i {i k ^ d) if and only if Qij < Qi^. Now, define the following 
lengths I on the edges of the graph from the perspective of node i. If (z — ^ j — »• d) G 7r(z), then 
l{i,j) = Qij, l{j,d) = 1. l{i,d) = Qii + 1. Pick Mi = maxj Qij + 2. Let l{x,y) = Mi for all other 
edges. Now, any path (i — ^ j — > d) G 7r(i) will have length Qij, path {i — > d) will have length Qa. 
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This preserves the preference Ust across these paths. Most other paths wih have a last segment of 
length Ali, so will be longer than l(i,d). The only exception is paths that pass through a j such 
that {i ^ j ^ d) £ vr(i). However, for these paths, the only way to arrive at j without following 
the direct edge would be to pass through an edge of length Mi, so these paths too will be 
longer than l{i,d). □ 

Theorem 5.13. Fractional SPP is PPAD-hard even if all preferred paths are preference- ordered 
based on the path length (where each node defines its own distances on the edge lengths, and these 
distances form a metric and obey triangle inequality), assuming we may only use edges from a given 
template graph. 

Proof. This is very similar to the proof of Theorem 5.12. However, in this case, we must remove 
from the template any edges directly from a node i created in the reduction from Theorem 5.10 
to the destination d, since any of these edges would necessarily be a shortest path (and therefore 
a highest preference path) from the node i to d. Instead, we will add one additional node i' for 
every i ^ d, and replace all paths of the form {i d) with a path (z i' d). We must also 
remove from the template any edges of the form {x,j') for any x ^ j. Otherwise, a path ending 
in {x j' d) would be at least as short as the same path ending in {x ^ j ^ j' ^ d), so we 
would not be able to enforce use of the new edges. Now we will define edges lengths / as follows 
(from the perspective of a node i). 

If {i ^ j ^ d) e 7r(i), then l{i,j) = Q,j, = Qij, l{j',d) = 1. l{i,i') = 2Qii + 1. 

l{i' , d) = 1. For two paths {i ^ j ^ d) £ 7r(i) and {i ^ k ^ d) £ vr(i), define l{j, k) = Qij + Qik- 
Let Mi = maxj SQij. l{x,y) = M for all other edges {x,y) (excluding the edges that have been 
removed from the template: (j, d) for all j and (j, k') for all j ^ k). 

As in the previous proof, the preference order is preserved. However, we must also verify that 
triangle inequality holds. Clearly, the length 1 edges obey this, since they are the shortest edges in 
the graph. Consider a length Qij edge {i,j). Any other path that starts at i and ends at j must 
either traverse a length Mi edge into j or a length Qij edge into j, so this is the shortest route from 
i to j. Consider a length Qij edge A path that starts at j must traverse either a length Mj 

edge or a length Qij edge, so this is also a shortest route. Consider a length Qij + Qij. edge (j, k). 
Any path into or out of j must traverse an edge of length Mi or an edge of length Qij, and likewise 
for k. Therefore, a path out of j and into k must traverse at least Qij + Qik- Finally, consider any 
length Mi edge. At least one end of the edge must be at some x such that (i — > x ^ d) is not in 
Tr{i), and any other edge into or out of this node will also have length Mj. Therefore, the lengths 
obey triangle inequality. □ 

Notice, if any edge may be used, and if the preferences are based on shortest path lengths for a 
metric defined for each node, then there is a trivial algorithm for finding an equilibrium: each node 
only follows the "direct to destination" path. Since a metric must obey triangle inequality, this 
path length cannot be strictly longer (cannot be less preferred) than any path including additional 
nodes. Theorem 5.10 together with Theorem 3.3 implies that Fractional SPP is PPAD- 
hard. Therefore, it is natural to next consider special instances that might be easier to solve. For 
instance, in real world internet routing, we would like to see path preferences primarily based on 
shortest paths. What would happen if we restrict ourselves to path preferences that echo the real 
world? Unfortunately, by adding appropriate edge lengths to the above reduction, we show that 
Fractional SPP is PPAD-hard even if all preferences are based only on shortest path lengths. 
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5.4.3 Approximate Fractional SPP 

There are two notions of approximation for FSPP : e-solution is defined by Haxell and Wilfong [21] 
and e-stable solution is defined by Kintali [27]. Below we present their definitions : 

e-solution (Haxell and Wilfong [21]) : An e-solution is defined as a set it; = {w^ : v ^ d} of 
assignments : Tr{v) — [0, 1] satisfying the following: 

1. Unity condition: for each node v, J2pen{v) '^v{P) < 1 

2. Tree condition: for each node v, and each path S with start node u, J2p&ir{v S) ^f(-f) ^ 
WuiS) + e. 

3. For any node v and patli Q starting at v, one of the following holds: 

• J2peTT{v) ''^v{P) = 1, and for each P in 7r{v) with > 0, P >v Q', or 

• There exists a proper suffix 5 of Q such that J2peTT(v s) ) = i^uiS) + e, where u is 
the start node of S, and for each P G Tr{v, S) with Wv{P) > 0, P >v Q- 



e-SOLUTlON OF FSPP : Given an instance of FSPP, find a stable weight assignment w that 
overfills each subpath by at most e. 



Using Scarf's lemma, Haxell and Wilfong [21] proved that every instance of FSPP has an e- 
solution. We observe that their proof is a polynomial time reduction from e-SOLUTlON OF FSPP to 
Scarf, thus showing PPAD-membership of the former. For more details we refer the reader to [21] . 

e-stable Solution (Kintali [27]) : An e-stable solution is a feasible solution such that for any node 
V and path Q starting at v, one of the following holds: 

• 1 — e < J2peiT{v) '^v{P) < 1) and for each P in Tr{v) with Wv{P) > 0, P >v Q', or 

• There exists a proper suffix 5* of Q such that Wa{S) — e < J2p&v{v S) "^viP) < Wu{S), where 
u is the start node of S, and for each P G Tr{v, S) with Wv{P) > 0, P >v Q- 



e-STABLE SOLUTION OF FSPP : Given an instance of FSPP, find a weight assignment w that 
is exactly feasible but may underfill a higher preference subpath by at most e. 



Furthermore, we can define a new notion of approximate equilibrium which encompasses both 
of these previous definitions: say APPROXIMATE-FSPP. It is easy to verify that the reduction 
from Theorem 5.10 also reduces finding an e- approximate equilibrium in a preference game to 
Approximate-FSPP. Combined with the previous observations in this section, we get the following 
theorem. 

Theorem 5.14. Approximate-FSPP is PPAY)- complete. 

□ 
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5.5 Kernels in Digraphs 

Let D{V,A) be a directed graph. Let I{v) denote the in-neighborhood of a vertex v i.e., I{v) 
is V together with the vertices u such that {u, v) € A. A set K of vertices is a chque if every two 
vertices in K are connected by at least one arc. A set of vertices is called independent if no two 
distinct vertices in it are connected by an arc. A subset of V is called dominating if it meets I{v) for 
every v gV. A kernel in D is an independent and dominating set of vertices. A directed triangle 
shows that not all digraphs have kernels. 

A non-negative function / on F is called fractionally dominating if X^ug/(^) f{u) ^ 1 for every 
vertex v. The function is strongly dominating if for all v, J2ueK fi^) ^ ^ ^'^^ some clique K 
contained in I{v). A non-negative function / on F is called fractionally independent if YlueK /("") ^ 
1 for every clique K. A fractional kernel is a function on V which is both fractionally independent 
and fractionally dominating. When it is also strongly dominating, it is called a strong fractional 
kernel. As in the integral case, a directed triangle shows that not all digraphs have fractional 
kernels. 

An arc {u,v) is called irreversible if {v,u) is not an arc of the graph. A cycle in D is called 
proper if all of its arcs are irreversible. A digraph in which no clique contains a proper cycle is 
called clique- acyclic. Aharoni and Holzman [2] proved that every clique-acyclic digraph has a strong 
fractional kernel. We define a computational problem - Strong Kernel : given a clique-acyclic 
digraph D(y,E) with largest clique of constant size, find a strong fractional kernel. For these 
graphs, the proof of [2] is a polynomial-time reduction from Strong Kernel to Scarf. Theorem 
5.15 establishes PPAD-hardness of Strong Kernel. 



Strong Kernel: Given a clique-acyclic digraph with the largest clique of constant size, 
find a fractional weight assignment to the nodes that is fractionally strongly dominating and 
fractionally independent. 



Theorem 5.15. Degree 3 Preference Game <p Strong Kernel. 

Proof. We are given a preference game over player set [n]. We construct the following digraph 
D = {V,E). For each player i, we introduce vertex {i,i) and a vertex {i,j) for each j in out(i). 
We have an edge from {i,j) to {i,k) if i prefers j over k. For each {i,j), j ^ i, we also have an 
additional vertex I{i,j) that has an edge from and an edge into {i,j). 

We now claim that the preference game has an equilibrium if and only if D has a strong 
fractional kernel. Let the preference game have an equilibrium w. Consider the following function 
/ on V. We set f{{i,j)) = Wij and f{I{i,j)) = 1 — f{{j,j)). We have two kinds of maximal 
cliques. One kind is the set {{i,j)} for a given i; we have f{{i, j)) = "^jWij = 1. The other 
maximal cliques are the edges {{j, j) , I{i, j)) and {I{i,j), {i,j). Since f{I{i,j)) = 1 — f{{j,j)) and 
fiihj)) < f{{jjj))j it follows that / is fractionally independent. 

We next show that / is fractionally strongly dominating. For vertex I{i,j), this is immediate 
since f{I{i,j)) + f{{j,j)) = 1. Consider a vertex {i,j). If j is the least preferred player of i with 
Wij > 0, then the vertex {i,j) is covered by the clique consisting of {i,j') over all j' that are at 
least as preferred to i as j. Otherwise, Wij = Wjj, in which case f{I{i,j)) + f{{i,j)) = 1. Thus, / 
is strongly dominating. 

Suppose D has a strong fractional kernel /. We set Wij = f{{i,j)). By the fractional inde- 
pendence property applied to the cliques formed by I{i,j) and {i,j), we obtain that Wij < Wjj. 
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Consider a vertex The set of vertices with edges into {i,j) is the union of two chqucs - the 

set of {i,k) with k >i j, and the set If j is the least preferred player such that 

f{{i,j)) is positive, then the sum of the weights in the first clique is 1; otherwise, the sum of the 
weights in the second clique is 1, yielding Wij = Wjj. This establishes the stability of w. 

The graph constructed above does not satisfy the clique-acyclic property. This is because 
the clique formed by the set of {i, k) with k >j j contains proper cycles. When the outde- 
gree of every player in the preference game is at most 3 (including the self-loop), then we can 
achieve the desired condition by making the following changes to the graph. Suppose the pref- 
erence list of player i is ii,i2,i- Then, we replace the edge , with a three-hop path 
J{i,ii)), {J{i,ii), K(i,ii)), (K{i,ii), Wc do the same with i2- Finally, wc add the 
edges {K{i,ii), K{i,i2)) and {K{i,ii), K(i,i2)). We can verify that in any strong fractional ker- 
nel, the weight of K{i,ii) (resp., K{i,i2)) would be identical to that of (resp., (1,^2))- The 
remainder of the proof is same as before. The loop {K{i,ii), K{i,i2)) guarantees that no chque 
contains a proper cycle. □ 

6 Fractional Bounded Budget Connection Game 

We define a fractional variant of the Bounded Budget Connection game, as in [30, 31]. A 

fractional Bounded Budget Connection game (henceforth, a fractional BBC game) is specified by 
a tuple {V, d, c, b), and a length function for each u G V, where y is a set of nodes, d £ V is a 
distinguished destination node, c : V x V b : V —y and £u ■ V x V ^ Z (for each u & V) 

are functions. For any u,v eV, c{u,v) denotes the cost to u of directly linking to v, and lx{u,v) 
denotes the length of the link (u, v) from the perspective of x, if u has established this link. For 
any node u G y, b{u), specifies the budget u has for establishing outgoing directed links: the sum 
of the costs of the links established by u times the amount placed on each link should not exceed 
b{u). 

A strategy for node « is a weight function Wu : ^ [0, 1] that u places on each outgoing edge 
{u^v) : V £ V such that ^(y^) c(n, u) x Wu{v) < b{u). Let Wu denote a strategy chosen by node u 
and let W = {wu : u ^V} denote the collection of strategies. The network formed by W is simply 
the directed, capacitated complete graph G{W), in which the capacity of the directed edge {u,v) 
is Wu{v). The utility of a node u is given by —f{u), where f{u) is the cost of a 1-unit minimum 
cost fiow from u to d, according to the capacities given by W and the lengths from the perspective 
of u given by We assume that there is also always an additional edge from each node to d with 
cost 0, capacity 00, and length = some large integer M » nm.aDiix,u,v ix{u,v); we refer to M as the 
disconnection penalty. In other words, if the max fiow from u to t; is a < 1, then f{u) is the cost 
of the minimum cost a flow from u to d plus (1 — a) • M. 



Fractional BBC: Given a set V of nodes, a destination d, a cost function c : V x V ^ Z, a 
budget function b : V ^ Z, and a length function £u ■ V x V ^ Z. Find a weight assignment 
Wu -V ^ [0, 1] for each u eV such that (a) J2{u v) ^i'^i ^) ^ '^u{v) < b{u) and (b) Wu minimizes 
the cost of a minimum cost flow from u to d, assuming the capacity of an edge {x,y) is Wx{y)- 



Theorem 6.1. Preference Game <p Fractional BBC 

Proof. We use a similar reduction from a preference game to fractional BBC. Given any instance P 
of the preference game. We will create an instance B of fractional BBC = (F, d, c, 6), where V = S, 



43 



d = an additional node, Vi,j € V: c{i,j) = 1, Vf: b(i) = 1, plus length function li for each i EV, 
defined as follows. Let pi{k) = the number of j such that j >i k. Vj ^ i, d) = 1, = Pi{j)- 

Vj ^ i^k ^ i, k) = li{k,j) = \S\ + 1. d) = 1 +pi{i). Given a solution to B, define a solution 
to P: set Wi{j) = the weight placed on edge (for j / i), and Wi{i) = the weight placed on 
edge {i,d). 

Consider any instance P of the preference game, consisting of a set of players S and a preference 
relation >j for each i & S. We will create an instance B of fractional BBC = {V,d,c,b), where 
V = S, d = an additional node, \fi,j G V: c{i,j) = 1, Vi: b{i) = 1, plus length function li for 
each i £ V, defined as follows. Let Pi{k) = the number of j such that j >j k. Vj 7^ i, d) = 1, 
k{hi) = PiU)- / / i,k{3,k) = li{k,i) = \S\ + 1. li{i,d) = 1 +Pi{i). Given a solution to B, 
define a solution to P by setting Wi{j) = the weight placed on edge (for j i), and Wi{i) = 
the weight placed on edge {i,d). 

Since the total cost for all edges is 1, and the total budget for a node is 1, each node in B 
will place total weight 1 on edges adjacent to it. This exactly corresponds to the requirement that 
'^jWi{j) = 1 in P. The possible paths for a one-unit flow from i to d in B are: (1) the path 
consisting of only edge {i,d), which has cost pi{i) + 1 < jS*! + 1, (2) a path of the form {i,j,d) 
through some other node j, which has cost Pi{j) + 1 < |5| + 1, or (3) a path including some edge 
(j, k) for j i, k ^ i, which has cost > jS"] + 1. Therefore, a minimum cost flow will only use paths 
of the form {i,d) and {i,j,d), so the requirement in P that Wi{j) < Wj{j) corresponds to using 
the weight j places on edge (j, d) as a capacity on that edge when finding the min-cost fiow. Now, 
we only need to show that a node's best response in B exactly corresponds to a lexicographically 
maximal weight assignment in P. 

Suppose we have a best response for node i in B that corresponds to a weight assignment w in P 
that is not lexicographically maximal for i. Then, there is some assignment w' = w'iU {wj j i} 
such that for some j G S, Ylk>ij ''^ii^) Ylk>ij'^ii^)- There must be some k'^ e S such that 
k~^ >i j and w[{k~^) > Wi{k~^), and there must be some k~ £ S such that -^{k~ >j j) and w'.i{k~) < 
Wi{k~). Suppose we move e weight in the best response in B from Pj^,- to Pih+. Pi{k~) > pi{k~^), 
so moving this weight will decrease the cost of a minimum cost fiow, contradicting the fact that 
this was a best response. 

Suppose we have a lexicographically maximal weight assignment w for P that does not corre- 
spond to a best response for node i in B. Then, in B, i could move weight from some path Pij 
to a different path Pj^ to decrease the cost of its min-cost fiow. This means that Pi{k) < Pi{j), or 
the number of nodes preferred by i over k is smaller than the number of nodes preferred by i over 
j. Since preference relations arc transitive, this implies that k >i j. However, since Pj^ had space 
left, Wi{k) < Wk{k), so w is not lexicographically maximal. □ 

Theorem 6.2. Fractional BBC <p Personalized Equilibrium. 

Proof. Consider any instance of fractional BBC. Create a player in the matrix game for each node 
in the BBC instance. Assign the player one action for each available edge in the BBC instance. For 
any hyperedge in the matrix game, a player's payoff is negative of the length of the shortest path 
to the destination made up of a subset of the edges represented by that hyperedge (or negative of 
the disconnection penalty if there is no such path to the destination) . The proof that this preserves 
the set of equilibria is similar to the above proof for fractional SPP games. □ 
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Figure 2: We show these problems to be PPAD-complete. Each reduction line is labeled with the 
Section or Citation where the reduction can be found. Two of these reductions, Strong Kernel 
<P Scarf and Core-Balanced-NTU <p Scarf, are only polynomial time reductions for the 
specific versions of the problems discussed in this paper. In our definition of Strong Kernel, 
formally given in Section 5.5, we assume that the largest clique in the graph has constant size, 
since otherwise it is not clear whether the probl^ is even in TFNP. Core-Balanced-NTU, as 
defined in Section 5.3, assumes that the game description explicitly lists the possible coalitions and 
their Pareto-optimal outcomes. 
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